Senior Big Data Engineer (Databricks) - RELOCATION TO ABU DHABI

SoftServe
Edinburgh
5 days ago
Create job alert

Please note: this position requires relocation to Abu Dhabi for a minimum period of 12 months. Project duration: 36 months+. Softserve will support relocation of selected candidates.


WE ARE

SoftServe is a global digital solutions company with headquarters in Austin, Texas, founded in 1993. Our associates are currently working on 2,000+ projects with clients across North America, EMEA, APAC, and LATAM. We are about people who create bold things, who make a difference, who have fun, and who love their work.

Big Data & Analytics Center of Excellence, data consulting and data engineering branch at SoftServe. Starting as a group of three enthusiasts back in 2013, hundreds of Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others.


IF YOU ARE

Experienced with Python/PySpark

Proficient working with Databricks Lakehouse architecture and principles

Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems

Experienced with Azure cloud technologies Modern Data Estate such as Azure Data Factory, Azure DevOps, Azure Synapse, Azure Data Lake Services

Skilled with advanced SQL working with relational databases

Knowledgeable of database and data warehouse design best practices

Experienced designing, building, and scaling streaming and batch data pipelines

Able to suggest the best solution among different options and conduct trade-off analysis, solve the problems

Engaging in communication with stakeholders in written and verbal form (Upper-Intermediate English level)


YOU WANT TO

Be part of a team of data-focused Engineers dedicated to continuous learning, improvement, and knowledge sharing every day.

Work with a cutting-edge technology stack, including pioneering services from major cloud providers that are at the forefront of innovation.

Engage with customers of diverse backgrounds, ranging from large global corporations to emerging start-ups preparing to launch their first product.

Be involved in the entire project lifecycle, from initial design and proof of concept (PoC) to minimum viable product (MVP) development and full-scale implementation.


TOGETHER WE WILL

Address different business and technology challenges, engage in impactful projects, use top-notch technologies, and drive multiple initiatives as a part of the Center of Excellence.

Support your technical and personal growth—we have a dedicated career plan for all roles in our company.

Investigate new technologies, build internal prototypes, and share knowledge with SoftServe Data Community.

Upskill with full access to Udemy learning courses.

Pass professional certifications, encouraged and covered by the company.

Adopt best practices from experts while working in a team of top-notch Engineers and Architects.

Collaborate with world-leading companies and attend professional events


All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability, sexual orientation, gender identity/expression, or protected veteran status. SoftServe is an Equal Opportunity Employer.

Related Jobs

View all jobs

Senior Big Data Engineer (Databricks) - RELOCATION TO ABU DHABI

Senior Big Data Engineer (Databricks) - RELOCATION TO ABU DHABI

Senior Data Architect

Senior Data Engineer (Databricks, Financial Services)

Senior Data Engineer

Senior Data Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Top 10 Best UK Universities for Data Science Degrees (2025 Guide)

Discover ten of the strongest UK universities for Data Science degrees in 2025. Compare entry requirements, course content, research strength and industry links to choose the right programme for you. Data is the currency of the modern economy, and professionals who can wrangle, model and interpret vast datasets are in demand across every sector—from biotechnology and finance to sport and public policy. UK universities have been at the forefront of statistics, artificial intelligence and large-scale computing for decades, making the country a prime destination for aspiring data scientists. Below, we profile ten institutions whose undergraduate or postgraduate pathways excel in data science. Although league tables vary each year, these universities have a proven record of excellence in teaching, research and industry collaboration.

Veterans in Data Science: A Military‑to‑Civilian Pathway into Analytical Careers

Introduction The UK Government’s National AI Strategy projects that data‑driven innovation could add £630 billion to the economy by 2035. Employers across healthcare, defence, and fintech are scrambling for professionals who can turn raw data into actionable insights. In 2024 alone, job‑tracker Adzuna recorded a 42 % year‑on‑year rise in data‑science vacancies, with average advertised salaries surpassing £65k. For veterans, that talent drought is a golden opportunity. Whether you plotted artillery trajectories, decrypted enemy comms, or managed aircraft engine logs, you have already practised the fundamentals of hypothesis‑driven analysis and statistical rigour. This guide explains how to translate your military experience into civilian data‑science language, leverage Ministry of Defence (MoD) transition programmes, and land a rewarding role building predictive models that solve real‑world problems. Quick Win: Take a peek at our live Junior Data Scientist roles to see who’s hiring this week.

Quantum-Enhanced AI in Data Science: Embracing the Next Frontier

Data science has undergone a staggering transformation in the past decade, evolving from a niche academic discipline into a linchpin of modern industry. Across every sector—finance, healthcare, retail, manufacturing—data scientists have become indispensable, leveraging statistical methods and machine learning to turn raw information into actionable insights. Yet as datasets grow ever larger and machine learning models become more computationally expensive, there are genuine questions about how far current methods can be pushed. Enter quantum computing, a nascent but promising technology grounded in the counterintuitive principles of quantum mechanics. Often dismissed just a few years ago as purely experimental, quantum computing is quickly gaining traction as prototypes evolve into cloud-accessible machines. When paired with artificial intelligence—particularly in the realm of data science—the results could be game-changing. From faster model training and complex optimisation to entirely new forms of data analysis, quantum-enhanced AI stands poised to disrupt established practices and create new opportunities. In this article, we will: Explore how data science has reached its current limits in certain areas, and why classical hardware might no longer suffice. Provide an accessible overview of quantum computing concepts and how they differ from classical systems. Examine the potential of quantum-enhanced AI to solve key data science challenges, from data wrangling to advanced machine learning. Highlight real-world applications, emerging job roles, and the skills you need to thrive in this new landscape. Offer actionable steps for data professionals eager to stay ahead of the curve in a rapidly evolving field. Whether you’re a practising data scientist, a student weighing up your future specialisations, or an executive curious about the next technological leap, read on. The quantum era may be closer than you think, and it promises to radically transform the very fabric of data science.