ETL Developer

Ntrinsic Consulting
Greater London
1 week ago
Create job alert

Job Title: ETL Developer (Python / Big Data Engineer)

Location:Hybrid (2-3 days in customer office)

Mode of Work:Hybrid work environment, with 2-3 days onsite at the customer office.

Job Description:

We are looking for an experiencedETL Developerwith a strong background in Python development and Big Data technologies to join our team. As an ETL Developer, you will be responsible for the design, development, and implementation of data processing pipelines using Python, Spark, and other related technologies to handle large-scale data efficiently. You will also be involved in ensuring the integration of data into cloud environments such as Azure, alongside basic DevOps tasks and RDBMS fundamentals.

Responsibilities:

  • Develop and maintain ETL pipelines using Python for data extraction, transformation, and loading.
  • UtilizeApache Sparkfor big data processing to handle large datasets and optimize performance.
  • Work with cloud technologies, particularlyAzure, to deploy and integrate data solutions.
  • Implement key Python concepts and leverage libraries/packages like Pandas, NumPy, and others for data manipulation.
  • Perform data integration tasks involving various data sources and structures.
  • Collaborate with cross-functional teams to design and implement robust, scalable data solutions.
  • Applybasic DevOpspractices to manage and automate workflows within the ETL process.
  • Ensure best practices in database management and integration withRDBMSsystems.
  • Participate in troubleshooting, optimization, and performance tuning of data processing systems.

Required Skills and Experience:

  • Proficient in Pythonwith hands-on experience in key libraries (Pandas, NumPy, etc.) and a deep understanding of Python programming concepts.
  • Solid experience inBig Data ProcessingusingApache Sparkfor large-scale data handling.
  • Basic DevOpsknowledge and familiarity with CI/CD pipelines for automating workflows.
  • Understanding ofAzure Fundamentalsand cloud data solutions.
  • Strong understanding ofRDBMS database fundamentals(SQL, relational data modelling, etc.).
  • Previous experience in ETL development and data integration.
  • Senior/Lead level experience with hands-on development in relevant technologies.
  • Excellent problem-solving skills and ability to optimize data workflows.
  • Familiarity with cloud-based data storage and processing technologies in Azure.
  • Experience working in Agile or other collaborative development environments.

Seniority level

Mid-Senior level

Employment type

Contract

Job function

Engineering and Information Technology

Industries

IT Services and IT Consulting

#J-18808-Ljbffr

Related Jobs

View all jobs

Business Intelligence Developer (SQL / ETL / PowerBI)

Business Intelligence Developer (SQL / ETL / PowerBI)

Business Intelligence Developer

BI Developer

Graduate BI Developer

Hadoop Big Data Developer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 Essential Books to Read to Nail Your Data Science Career in the UK

Data science continues to be one of the most exciting and rapidly evolving fields in tech. With industries across the UK—ranging from finance and healthcare to e-commerce and government—embracing data-driven decision-making, the demand for skilled data scientists has soared. Whether you're a recent graduate looking for your first role or a professional aiming to advance your career, staying updated through books is crucial. In this article, we explore ten essential books every data science job seeker in the UK should read. Each book provides valuable insights into core concepts, practical applications, and industry-standard tools, helping you build skills employers are actively looking for.

Navigating Data Science Career Fairs Like a Pro: Preparing Your Pitch, Questions to Ask, and Follow-Up Strategies to Stand Out

Data science has taken centre stage in the modern workplace. Organisations rely on data-driven insights to shape everything from product innovation and customer experience to operational efficiency and strategic planning. As a result, there is a growing need for skilled data scientists who can analyse large volumes of data, build predictive models, communicate findings effectively, and collaborate cross-functionally. If you are looking to accelerate your data science career—or even land your first role—attending data science career fairs can be a game-changer. Unlike traditional online applications, face-to-face interactions let you showcase your personality, passion, and communication skills in addition to your technical expertise. However, to stand out in a busy environment, you need a clear strategy: from polishing your personal pitch and asking thoughtful questions to following up with a memorable message. In this article, we’ll guide you through every step of making a strong impression at data science career fairs in the UK and beyond.

Common Pitfalls Data Science Job Seekers Face and How to Avoid Them

Data science has become a linchpin for decision-making and innovation across countless industries, from finance and healthcare to tech and retail. The demand for data scientists in the UK continues to climb, with businesses seeking professionals who can interpret complex datasets, build predictive models, and communicate actionable insights. Despite this high demand, the job market can be extremely competitive—and many applicants unknowingly fall into avoidable traps. Whether you’re an aspiring data scientist fresh out of university, a professional transitioning from a quantitative role, or a seasoned analyst looking to expand your skill set, it’s crucial to navigate your job search effectively. In this article, we explore the most common pitfalls data science job seekers face and provide pragmatic advice to help you stand out. By refining your CV, portfolio, interview strategies, and communication skills, you can significantly increase your chances of landing a rewarding data science role. If you’re looking for your next data science job in the UK, don’t forget to explore the listings at Data Science Jobs. Read on to discover how to avoid critical mistakes and position yourself for success.