Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Senior Data Engineer London, United Kingdom

Engelhart CTP Group
London
1 month ago
Create job alert

Engelhart was founded in 2013 by BTG Pactual Group as a commodities trading company. Our business model is “asset light” and highly diversified – giving us the ability to adapt effectively and nimbly to changing market conditions. We have assembled successful multidisciplinary teams, leveraging advanced fundamental analysis with deep quantitative and weather research capabilities. Our activities are underpinned by strong risk management practices and by powerful technology and operational excellence. We have exceptional teams with diverse global backgrounds and decades of experience, and are driven by a highly collaborative culture, across products and competencies.

In 2024, Engelhart acquired Trailstone, a global energy trading and technology company. The acquisition provides us with new expertise, analytics and proprietary technology which is being used to provide risk management and optimisation services to help maximise the value of our clients’ renewable power. The acquisition also expanded Engelhart’s capabilities into physical natural gas across North America, a critical fuel to support the energy transition.

Our talented and experienced individuals work together according to its four company values:be bold, be collaborative, be proactive, be your best.

About the Role

As a member of the Tech Data, AI & UX team, the Senior Data Engineer's responsibilities involve preparing data for analytical or operational uses, typically building and maintaining data pipelines to pull together information from different sources; integrating, consolidating and cleansing data; and structuring it for use in individual analytics applications in a ready-to-use form to data scientists who are looking to run queries and algorithms against the information for predictive analytics, systematic trading, machine learning and data mining purposes.

The Technology Data Analytics team as a whole is responsible for developing data solutions to support business decisions, directly or indirectly, by providing raw / pre-processed data to Data Scientists and Traders. This is achieved with agile methodology and a lot of teamwork.

Always oriented to achieving best of data quality, performance and self-service from user perspectives, the area fosters technical and business discussions seeking continuous improvement in results, with continuous advent of cutting-edge technology in Data Science, Cloud Computing, Containerization and AI.

This role requires a highly skilled individual with technical depth, strong problem-solving capabilities, and the ability to collaborate effectively in a dynamic and fast-paced environment. This will be a full-time role, owning the followingresponsibilities:

  • Working closely with the business, providing data support to its initiatives and projects, collecting requirements and discussing solutions with Data Analysts, Quant Developers, Researchers.
  • Quickly ingesting structured or unstructured data from new sources, through scraping scripts, services, jobs, crawlers, ETL and streaming.
  • Data cleaning, enrichment or transformation using most appropriate tools for quick delivery and greater reuse.
  • Continuously developing the Data framework of the company, with the aim of streamlining onboarding, distribution and visualization.
  • Safe and efficient persistence of data via several types of storage, such as DBs, warehouses, and data lakes of different formats.
  • Internally distributing data through in-house APIs, python packages, and/or direct DB queries.
  • Maintaining existing data pipelines and databases.
  • Supporting the automation of post-processing routines when required, including prediction models and visualization.
  • Supporting Data Scientists in the use of common internal libraries in Python, cloud resources, and access to existing data.
  • Knowledge retention and maintenance of a KB on data sources and pipelines.
  • Developing new visualizations using data visualization platforms.

About You

The followingeducation, experiences and skills are essential for application:

  • Background in Engineering, Computer Science, Systems Analysis, Data Science, Information Systems, or substantive commensurate experience.
  • Experience with Commodities or Financial Markets.
  • Experience interfacing with traders and quant developers.
  • Excellent communication and organizational skills.
  • Proven ability to communicate data concepts to both technical and business users, influencing decision making.
  • Proven ability to problem solve and resolve conflict in a work environment.
  • Proven, extensive track record of project ownership and driving results end-to end.
  • Advanced proficiency in scripting languages such as Python for Data Crawling, Parsing, etc. Master Pandas library.
  • Significant experience working with Analytical / Time-series databases (e.g. Redshift, Clickhouse).
  • Substantive working experience with Docker Containers.
  • Substantive working experience with DevOps or GIT source code repository.
  • Use of IaC and CI/CD with AWS (eg. Cloud Formation, CDK).
  • Proactive, pragmatic problem-solving mentality, with a strong bias for action.
  • Positive, team-oriented mindset.
  • Shows ownership and accountability in all aspects of work.
  • A proven ability to continuously learn and challenge the status quo.

In addition, the following skills are not required, but highly desirable for this role:

  • Exposure to integration tools such as Rest API, Web API, Entity Framework, SSIS.
  • Knowledge of other common AWS resources (S3, Lambda, Athena, EMR, Faregate, Kinesis, EC2, API Gateway, CloudWatch)
  • Big Data processing tools & formats such as Apache Spark, Dask, Databricks, Hadoop, MapReduce, Parquet, Presto, Sqoop, Hive, Hbase.
  • Experience with RAD / Agile methods.
  • Understanding of AWS Cloud Architecture and its Security (eg. IAM, Cognito).
  • Experience of visualization libraries such as Plotly.
  • Knowledge of web formats (eg. html, json), and experience with web scraping.
  • A combination of relevant statistical / math knowledge.
  • Curiosity in new technologies surrounding AI, ML, IoT, etc.

Who You Are

  • You are customer obsessed.
  • You have strong communication skills.
  • You believe in the power of a team, diversity of thought, and unity of action.
  • You always act with integrity, keep your commitments, and practice transparency.
  • You think boldly, lead with courage, and demand the highest standards.
  • You drive for results and act like an owner.

What we offer

  • Competitive compensation and participation in Engelhart’s discretionary bonus plan.
  • 25 days of annual holiday entitlement, excluding UK public holidays.
  • Robust benefits package such as medical, dental, life insurance, generous pension contribution, and supplemental benefits.
  • Eligibility to receive external and internal training in accordance with our Training & Development Policy.

We believe in inclusivity and are therefore dedicated to ensuring all employees – across gender identity, race, ethnicity, sexual orientation, religion, life experience, background and more – feel welcome and included in the company. We promote diversity because we believe it is essential to our ability to think holistically.

Create a Job Alert

Interested in building your career at Engelhart? Get future opportunities sent straight to your email.

Apply for this job

*

indicates a required field

First Name *

Last Name *

Preferred First Name

Email *

Phone

Location (City) *

Resume/CV *

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Thank you for your interest. Please confirm your notice period: *

Do you now, or will you in the future, require visa sponsorship to work in the UK? *

What salary range would you be seeking if you were successful in this recruitment process? *

If successful, are you able and willing to work in our Mayfair, London office at least three days per week? *

This role requires experience with: 1) scripting languages such as Python; 2) analytical / time-series databases such as Redshift or Clickhouse; and 3) Docker Containers.Can you confirm how you meet all 3? *

This role requires working experience in commodities or financial markets. Can you confirm how you meet this criteria? *


#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Data Engineer (London Markets)

Senior Managing Data Engineer

Senior Data Engineer

Senior Data Engineer - 12 Month FTC

Senior Data Engineer

Senior Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Best Free Tools & Platforms to Practise Data Science Skills in 2025/26

Data science continues to be one of the most exciting, high-growth career paths in the UK and worldwide. From predicting customer behaviour to detecting fraud and driving healthcare innovations, data scientists are at the forefront of digital transformation. But breaking into the field isn’t just about having a degree. Employers are looking for candidates who can demonstrate practical data science skills — analysing datasets, building machine learning models, and presenting insights that solve real business problems. The best part? You don’t need to spend thousands on premium courses or expensive software. There are dozens of high-quality, free tools and platforms that allow you to practise data science in 2025. This guide explores the best ones to help you learn, experiment, and build portfolio-ready projects.

Top 10 Skills in Data Science According to LinkedIn & Indeed Job Postings

Data science isn’t just a buzzword — it’s the engine powering innovation in sectors across the UK, from finance and healthcare to retail and public policy. As organisations strive to turn data into insight and action, the need for well-rounded data scientists is surging. But what precise skills are employers demanding right now? Drawing on trends seen in LinkedIn and Indeed job ads, this article reveals the Top 10 data science skills sought by UK employers in 2025. You’ll get guidance on showcasing these in your CV, acing interviews, and building proof of your capabilities.

The Future of Data Science Jobs: Careers That Don’t Exist Yet

Data science has rapidly evolved into one of the most important disciplines of the 21st century. Once a niche field combining elements of statistics and computer science, it is now at the heart of decision-making across industries. Businesses, governments, and charities rely on data scientists to uncover insights, forecast trends, and build predictive models that shape strategy. In the UK, data science has become central to economic growth. From the NHS using data to improve patient outcomes to financial institutions modelling risk, the applications are endless. The UK’s thriving tech hubs in London, Cambridge, and Manchester are creating high demand for data talent, with salaries often outpacing other technology roles. Yet despite its current importance, data science is still in its infancy. Advances in artificial intelligence, quantum computing, automation, and ethics will transform what data scientists do. Many of the most vital data science jobs of the next two decades don’t exist yet. This article explores why new careers are emerging, the roles likely to appear, how current jobs will evolve, why the UK is well positioned, and how professionals can prepare now.