Data Engineer

• Design data integration solutions that meet business requirements, utilising Microsoft Azure tools such as Azure Data Factory and SQL.
• Develop, implement, and maintain ETL pipelines to ensure efficient and secure data transfer between various systems, adhering to best practices for data processing and transformation.
• Design and maintain data models, ensuring data accuracy, consistency, and availability while considering scalability and performance optimisations.
• Implement data validation and quality checks to identify and rectify data anomalies, errors, and inconsistencies within integrated systems.
• Create and maintain comprehensive documentation for data integration solutions, including technical specifications, data flow diagrams, and operational procedures.
• Troubleshoot and resolve data integration issues, implement effective solutions and prevent recurrence.
• Stay updated on emerging technologies and industry trends related to data engineering and integration, applying this knowledge to improve integration processes and tools.