Jobs

Data Engineer


Job details
  • Snaphunt
  • 3 weeks ago

The Offer

  • Work within a company with a solid track record of success
  • Attractive salary & benefits
  • Excellent career development opportunities

The Job

Job Description:

We are looking for a skilled Data Engineer to join our team. The ideal candidate will have strong experience in designing, building, and maintaining scalable data pipelines and architectures. You will play a critical role in managing data workflows, ensuring data integrity, and optimizing data processing.


Responsibilities:

  • Data Pipeline Development: Design, build, and maintain scalable and efficient data pipelines to process and transform large datasets.
  • ETL & Data Integration: Develop and optimize ETL (Extract, Transform, Load) workflows for structured and unstructured data sources.
  • Big Data Processing: Work with PySpark and Pandas to handle large-scale data processing tasks.
  • Database Management: Design, implement, and manage relational (SQL) and non-relational databases for data storage and retrieval.
  • Cloud Technologies: Leverage cloud platforms such as AWS, GCP, or Azure to deploy and manage data infrastructure.
  • Collaboration: Work closely with data scientists, analysts, and software engineers to support analytical and machine learning projects.
  • Data Quality & Performance Optimization: Ensure data accuracy, consistency, and security while optimizing performance.
  • Monitoring & Troubleshooting: Identify and resolve data pipeline performance bottlenecks and failures.

The Profile

Required Work Experience:

  • 2+ years of experience in data engineering or a related field.
  • Proven experience developing ETL pipelines and data processing workflows.
  • Hands-on experience with PySpark, Pandas, and SQL.
  • Experience working with big data technologies such as Apache Spark, Hadoop, or Kafka (preferred).
  • Familiarity with cloud data solutions (AWS, GCP, or Azure).


Required Skills:

  • Programming: Strong proficiency in Python (PySpark, Pandas) or Scala.
  • Data Modeling & Storage: Experience with relational databases (PostgreSQL, MySQL, SQL Server) and NoSQL databases (MongoDB, Cassandra).
  • Big Data & Distributed Computing: Knowledge of Apache Spark, Hadoop, or Kafka.
  • ETL & Data Integration: Ability to develop efficient ETL processes and manage data pipelines.
  • Cloud Computing: Experience with AWS (S3, Redshift, Glue), GCP (BigQuery), or Azure (Data Factory, Synapse).
  • Data Warehousing: Understanding of data warehousing concepts and best practices.
  • Problem-Solving: Strong analytical skills to troubleshoot and optimize data pipelines.
  • Communication: Must be proficient in spoken English to collaborate with US-based teams.


Education Requirements:

  • Bachelor’s degree in Computer Science, Data Engineering, Information Technology, or a related field (preferred).
  • Equivalent work experience in data engineering will also be considered.

The Employer

Our client is a Wisconsin-based consulting firm dedicated to connecting top global talent with leading U.S. companies. Our client is specialize in sourcing skilled professionals, conducting rigorous screening and technical assessments, and preparing candidates for opportunities in the U.S. job market.


Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer - £125,000 - Snowflake - London - Hybrid

Data Engineer - £125,000 - Snowflake - London - HybridCompany Overview:My client is a leading global commodities merchant and infrastructure asset investor, specialising in the physical and financial trading of energy commodities. They leverage advanced data analytics and cutting-edge technology to optimise trading strategies and asset management. With a strong...

City of London

Data Engineering Manager

Data Engineering Manager – Financial Services | Cloud | SnowflakeHead of Data Engineering / Lead Data EngineerFlexible Hybrid working | Competitive Salary & BenefitsAre you an experienced Data Engineering Leader looking for a strategic role in a high-growth, data-driven organization?We are seeking a Senior Data Engineering Manager to lead a...

Loughton, Milton Keynes

Data Engineer / Architect - £68,500 - Remote

Data Engineer / Architect - £68,500 - RemoteRole Overview:This role would be perfect for a Senior Data Engineer, or junior architect looking to take a huge step up into a more enterprise role. You will have the opportunity to define and implement the enterprise data strategy for the organisation, leading...

Glasgow

Data Engineer

Data EngineerAre you ready to take ownership of a brand-new role and make a real impact?This is your chance to join a leader in high-tech eCommerce and logistics solutions their first ever Data Engineer.They're on an exciting journey, upgrading a major platform, and need a data expert to help shape...

Southampton

Data Engineer 70k

Job Title: Data EngineerLocation: BirminghamSalary: £50,000 - £70,000 per year + BonusBenefits:Private Health-careGenerous Bonus SchemeFlexible Working Options (Remote/Hybrid)About the Role:My client, a leading organisation in manufacturing, is seeking a skilled Data Engineer to join their growing team. This is an exciting opportunity for a data enthusiast with experience in designing,...

Birmingham

Data Engineer - DOORS implementation

Location: Yeovil (mostly onsite)Duration: 6 month contractRate: Inside IR35Role profile:Our client, a leading aerospace company, are looking for a data specialist to to support the implementation of the DOORS toolset.The specialist will play a crucial role in supporting the implementation of the DOORS toolset for the NMH Pre-contract & Programme...

Yeovil