Jobs

Data Engineer with Data Formats


Job details
  • Capgemini
  • London
  • 1 month ago

Get The Future You Want!

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Your Role

We are seeking a highly skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have a deep understanding of data engineering principles, data technologies, and a proven track record of designing and building complex data pipelines. This role requires strong expertise in SQL, various data formats, Python, and JavaScript to support our data-driven decision-making processes and enhance our data infrastructure.
• Architect and maintain scalable data pipelines using various programming technologies.
• Use SQL to query, transform, and process data across relational and NoSQL databases.
• Integrate data from APIs, flat files, and streaming sources for consistency and quality.
• Implement real-time data processing using Kafka or Solace.
• Manage data storage in systems and warehouses, optimizing for performance.
• Design data models and apply techniques like partitioning and indexing for efficiency.
• Handle multiple data formats (CSV, JSON, Parquet) and manage unstructured data.
• Utilize Python and JavaScript (Node.js) for data processing, automation, and ETL development.
• Leverage Microsoft technologies, Apache Spark, and Airflow for distributed computing.
• Implement DevOps tools (Jenkins, Git, Docker) for CI/CD and monitor pipeline performance.
 

Your Profile

• Bachelor’s or Master’s degree in Computer Science, Data Science, IT, or related field.
• 8+ years of experience in data engineering, architecture, or related roles.
• Proven track record in building and maintaining large-scale, complex data pipelines.
• Expertise in managing data infrastructure in high-volume environments.
• Strong foundation in designing and optimizing data systems and workflows.
 

About Capgemini

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world while creating tangible impact for enterprises and society. It is a responsible and diverse group of 350,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market-leading capabilities in AI, cloud, and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer with Data Formats

Get The Future You Want!Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us...

Capgemini London

Data Engineer

We are seeking a skilled and experienced Data Engineer with in-depth knowledge on data processing, data modelling, and data products for integration and visualization to join our Customer Insights & Analytics team at StarTech.comReporting to the Manager, Business Intelligence and Data Engineering, the Data Engineer will focus primarily on data...

StarTech.com-manuela London

Principal Data Engineer

AWS, ETL, PYTHON, LABDA, GLUEAbout the jobHere at Anson McCade we are partnering with a leading Digital Transformation Consultancy who are in need of an experienced Data Engineer to join a multi-disciplinary team building, supporting and maintaining User-Centred digital solutions that offer real value and work for everyone.Act as a...

Anson McCade London

Technology Data Engineer

Salary Range £58,579 - £66,057 Location Procode - Remote / Chandlers Ford Closing Date Until filled Job Profile Job Profile documentLooking for new energyTitle: Technology Data EngineerDepartment:Procode Location:Remote / Chandlers FordSalary:£58,579 - £66,057 + 15% Bonus Scheme Are you an experienced Data Engineer with skills in designing and developing data...

Utilita Energy Chandler's Ford

Senior Machine Learning Engineer

Senior / Lead Machine Learning EngineerThe Fitch Group Emerging technology group is seeking aSenior/Lead machine learning engineerto be part of a team that will be dedicated to build and support Generative AI, Machine learning and Data science solutions across the organization.Specific Emerging Technology team objectives are:Gen AI/ML technology implementation with...

Fitch Ratings Manchester

Research & Insights Analyst

Job Description<p style="color:rgb(0, 0, 0); font-family:"Times New Roman"; font-size:medium; font-style:normal; font-weight:400; letter-spacing:normal; orphans:2; text-indent:0px; text-transform:none; widows:2; word-spacing:0px; white-space:normal">JOB SPECIFICATION<p style="color:rgb(0, 0, 0); font-family:"Times New Roman"; font-size:medium; font-style:normal; font-weight:400; letter-spacing:normal; orphans:2; text-indent:0px; text-transform:none; widows:2; word-spacing:0px; white-space:normal">Reports to: Head of Technology<p style="color:rgb(0, 0, 0); font-family:"Times New Roman"; font-size:medium; font-style:normal; font-weight:400; letter-spacing:normal; orphans:2;...

Prime Trading Group Glasgow