We’re seeking an experiencedAzure Data Engineerto join our client on a1-year contract, starting in January 2024. ThisInside IR35role requires3 days onsite per weekat their Central London office, with the remaining time remote.

About the Role

In this role, you’ll leverage your expertise in Azure Data Factory and the Azure ecosystem to build scalable data pipelines, integrate diverse systems, and deliver high-performance, secure data solutions.

Key Responsibilities:

1. Data Pipeline Development:

• Design and deploy data pipelines usingAzure Data Factoryfor seamless ETL/ELT workflows.
• Maintain scalable, reliable data integration processes.

2. Integration and Orchestration:

• Work with Azure services likeData Lake,Databricks,Synapse Analytics, andSQL Database.
• Integrate data from hybrid and cloud-based systems.

3. Data Transformation and Modeling:

• UseADF mapping data flowsfor advanced transformations.
• Collaborate with stakeholders to structure data for analytics.

4. Performance Optimization:

• Monitor, troubleshoot, and enhance pipeline performance.
• Apply best practices to improve throughput and latency.

5. Security and Compliance:

• Implement secure access usingAzure RBACand managed identities.
• Ensure compliance with data privacy standards.

6. Collaboration and Documentation:

• Partner with architects and business stakeholders to align technical solutions with business goals.
• Document processes, configurations, and decisions.

What We’re Looking For

• Hands-On Expertise: Proven experience with Azure Data Factory and related services likeAzure SQL Database,Synapse Analytics, andData Lake.
• Technical Skills: Knowledge of Python, PowerShell, SQL, and other data integration tools like SSIS.
• Data Knowledge: Strong ETL/ELT principles, relational and non-relational databases, and data modeling.
• Problem-Solving Abilities: Experience with pipeline optimization and troubleshooting.
• Soft Skills: Excellent communication, teamwork, and analytical thinking to translate business needs into solutions.