Data Engineer- Perm

Vallum Associates
Nottingham
1 week ago
Create job alert

Job Title: Data Engineer (Azure, Databricks, and Microsoft Fabric)

Location: London ideally but open to Birmingham, Manchester or Newcastle

Duration: Perm


Overview:

We are looking for a highly skilledData Engineerwith expertise inAzure, Databricks, and Microsoft Fabricto design, build, and optimize data pipelines and infrastructure. This permanent role involves working with cutting-edge cloud technologies, enabling scalable and efficient data processing, analytics, and business intelligence solutions.

Key Responsibilities:

  • Design, develop, and maintainend-to-end data pipelinesusingAzure Data Services, Databricks, and Microsoft Fabric.
  • ImplementLakehouse architectureusingDatabricks Delta LakeandMicrosoft OneLake.
  • Develop and optimizeETL/ELT workflowsusingAzure Data Factory, Databricks, and Fabric Dataflows.
  • Work withAzure Synapse AnalyticsandFabric Data Warehousesfor large-scale data processing.
  • Ensure dataquality, security, and governanceacross cloud platforms.
  • Develop and managereal-time and batch data processingusingApache Spark and Databricks workflows.
  • Collaborate withdata analysts, scientists, and business teamsto enable data-driven decision-making.
  • Automate data pipelines usingPython, SQL, and Sparkfor efficiency and scalability.
  • Monitor and troubleshootdata performance issues, ensuring high availability.
  • Stay updated with the latest advancements inAzure, Databricks, and Microsoft Fabrictechnologies.

Required Skills & Qualifications:

  • 3+ yearsof experience in data engineering withAzure and Databricks.
  • Expertise inAzure Data Services(Azure Data Lake, Azure Synapse, Azure SQL).
  • Hands-on experience withDatabricks (Delta Lake, Spark, MLflow, Notebooks, Workflows).
  • Strong knowledge ofMicrosoft Fabric(OneLake, Data Factory, Synapse, Power BI).
  • Proficiency inSQL, Python, PySpark, or Scalafor data transformation and automation.
  • Strong problem-solving skills and ability to work in a fast-paced, agile environment.
  • Stakeholder Management


Priyanka Sharma

Senior Delivery Consultant

Office:

Email:

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Navigating Data Science Career Fairs Like a Pro: Preparing Your Pitch, Questions to Ask, and Follow-Up Strategies to Stand Out

Data science has taken centre stage in the modern workplace. Organisations rely on data-driven insights to shape everything from product innovation and customer experience to operational efficiency and strategic planning. As a result, there is a growing need for skilled data scientists who can analyse large volumes of data, build predictive models, communicate findings effectively, and collaborate cross-functionally. If you are looking to accelerate your data science career—or even land your first role—attending data science career fairs can be a game-changer. Unlike traditional online applications, face-to-face interactions let you showcase your personality, passion, and communication skills in addition to your technical expertise. However, to stand out in a busy environment, you need a clear strategy: from polishing your personal pitch and asking thoughtful questions to following up with a memorable message. In this article, we’ll guide you through every step of making a strong impression at data science career fairs in the UK and beyond.

Common Pitfalls Data Science Job Seekers Face and How to Avoid Them

Data science has become a linchpin for decision-making and innovation across countless industries, from finance and healthcare to tech and retail. The demand for data scientists in the UK continues to climb, with businesses seeking professionals who can interpret complex datasets, build predictive models, and communicate actionable insights. Despite this high demand, the job market can be extremely competitive—and many applicants unknowingly fall into avoidable traps. Whether you’re an aspiring data scientist fresh out of university, a professional transitioning from a quantitative role, or a seasoned analyst looking to expand your skill set, it’s crucial to navigate your job search effectively. In this article, we explore the most common pitfalls data science job seekers face and provide pragmatic advice to help you stand out. By refining your CV, portfolio, interview strategies, and communication skills, you can significantly increase your chances of landing a rewarding data science role. If you’re looking for your next data science job in the UK, don’t forget to explore the listings at Data Science Jobs. Read on to discover how to avoid critical mistakes and position yourself for success.

Career Paths in Data Science: From Entry-Level Analysis to Leadership and Beyond

Data is the lifeblood of modern business, and Data Scientists are the experts who turn raw information into strategic insights. From building recommendation engines to predicting market trends, the impact of data science extends across virtually every industry—finance, healthcare, retail, manufacturing, and beyond. In the UK, data-driven decision-making is critical to remaining competitive in a global market, making data science one of the most sought-after career paths. But how does one launch a career in data science, and how can professionals progress from entry-level analysts to senior leadership roles? In this comprehensive guide, we’ll explore the typical career trajectory, from junior data scientist to chief data officer, discussing the key skills, qualifications, and strategic moves you need to succeed. Whether you’re a recent graduate, transitioning from another technical field, or an experienced data scientist aiming for management, you’ll find actionable insights on forging a successful career in the UK data science sector.