Jobs

Staff Engineer (Market Data)


Job details
  • Kpler group
  • London
  • 1 day ago

At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors.

Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms. Our team of over 500 experts from 35+ countries works tirelessly to transform intricate data into actionable strategies, ensuring our clients stay ahead in a dynamic market landscape. Join us to leverage cutting-edge innovation for impactful results and experience unparalleled support on your journey to success.

The Market Data team is responsible for the ingestion, filtering, enrichment, and distribution of externally sourced data. This data is coming from thousands of sources related to maritime trade, and is critical to the business processing entities in Kpler, so they can provide a live and accurate picture of the global trade to our customers.

Your mission

  • Contribute to the roadmap in collaboration with Product Owners and Engineering Managers to upgrade our data pipelines to the next level of quality and reliability.
  • Design and implement the APIs, pipelines, and read models to publish our datasets.
  • Maintain and optimise our datasets and their schemas.
  • Guarantee data integrity and availability to our consumers.
  • Provide state of the art environments and tools to support the development team.
  • Share your expertise with team members, bringing help and guidance when needed. Connect to other engineers and bring insights to help us re-architect existing systems for scale and extensibility.

It will be a match if you

  • Have at least 8 years of experience as a Software Engineer / Data Engineer, including significant hands-on experience with using Kafka and Scala in a production environment, especially with Cats or Spark.
  • Can design and implement RESTful APIs.
  • Have experience with DevOps and Infrastructure as Code practices, especially on AWS.
  • Have experience with Data Processing Orchestration (Airflow).
  • Are fluent in English and have experience working in an international environment.

It will be better if you have experience with

  • Functional Programming frameworks such as fs2…
  • Big Data Management : DeltaLake, Medallion, Lineage…
  • Terraform, gitops, Kubernetes…
  • Machine learning, OCR, NLP…
  • ElasticSearch, GraphQL…
  • Python
  • SQL schema and PostgreSQL optimisations
  • AWS WAF principles

We are a dynamic company dedicated to nurturing connections and innovating solutions to tackle market challenges head-on. If you thrive on customer satisfaction and turning ideas into reality, then you’ve found your ideal destination. Are you ready to embark on this exciting journey with us?

We make things happen. We act decisively and with purpose, going the extra mile. We build together, fostering relationships and developing creative solutions to address market challenges. We are here to help, accessible and supportive to colleagues and clients with a friendly approach.

Our People Pledge

Don’t meet every single requirement? Research shows that women and people of color are less likely than others to apply if they feel like they don’t match 100% of the job requirements. Don’t let the confidence gap stand in your way, we’d love to hear from you! We understand that experience comes in many different forms and are dedicated to adding new perspectives to the team.

Kpler is committed to providing a fair, inclusive and diverse work environment. We believe that different perspectives lead to better ideas, and better ideas allow us to better understand the needs and interests of our diverse, global community. We welcome people of different backgrounds, experiences, abilities and perspectives and are an equal opportunity employer.

By applying, I confirm that I have read and accept theStaff Privacy Notice.

#J-18808-Ljbffr

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Staff Engineer (Market Data)

At Kpler, we are dedicated to helping our clients navigate complex markets with ease. By simplifying global trade information and providing valuable insights, we empower organisations to make informed decisions in commodities, energy, and maritime sectors.Since our founding in 2014, we have focused on delivering top-tier intelligence through user-friendly platforms....

Kpler group London

Software Engineer

Staff Engineer - £100k - Serverless, data and software - London (flexible) We are working with a very exciting challenger payments platform, shaping products that change real people's lives - including making savings and mortgages easier. We are looking for a product-focused software engineer with data experience, to lead new...

SR2 | Socially Responsible Recruitment | Certified B Corporation

Head of Data Engineering - Product & Plan for Better

About the TeamIn Sainsbury’s Tech, we power the UK’s number 1 multi-channel, multi-brand retailer. Our engineering teams are made up of inspired and multidisciplined individuals who are empowered to solve hard problems in ways our customers love and serve the needs of our business.The Head of Engineering is a critical...

Sainsbury's London

Staff Product Engineer

Intercom is an AI-first customer service platform that helps businesses deliver better, faster, more personalized support.Intercom is bringing AI-first Customer Service to the world, dramatically improving experiences for customers, support agents, and managers alike.Modern, fast, and easy-to-use, Intercom’s complete AI-first Customer Service Platform enhances the customer experience, improves operational efficiency,...

Intercom London

Enigma | Staff Machine Learning Engineer | Python | GPU's | C++ | Nvidia Jetsons | Machine Learning | Remote, UK

Staff Machine Learning Engineer | Python | GPU's | C++ | Nvidia Jetsons | Machine Learning | Remote, UK​The hiring company believes that building a great team starts with valuing its members. They seek top talent to create an environment where individuals can grow and learn from one another.Employees are...

Enigma Edinburgh

Enigma | Staff Machine Learning Engineer | Python | GPU's | C++ | Nvidia Jetsons | Machine Learning | Remote, UK

Staff Machine Learning Engineer | Python | GPU's | C++ | Nvidia Jetsons | Machine Learning | Remote, UK​The hiring company believes that building a great team starts with valuing its members. They seek top talent to create an environment where individuals can grow and learn from one another.Employees are...

Enigma London