ETL Developer

Cpl Healthcare
London
3 weeks ago
Applications closed

Related Jobs

View all jobs

BI Developer

Senior PySpark Developer

Graduate BI Developer

Software Engineer (Python React)

SQL Database Administrator Leicester /Hybrid

Senior Data Engineer

Job Title: ETL Developer (Python / Big Data Engineer)

Location:Hybrid (2-3 days in customer office)

Mode of Work:Hybrid work environment, with 2-3 days onsite at the customer office.

Type:Contract (Initial duration 6 months)

Job Description:

We are looking for an experiencedETL Developerwith a strong background in Python development and Big Data technologies to join our team. As an ETL Developer, you will be responsible for the design, development, and implementation of data processing pipelines using Python, Spark, and other related technologies to handle large-scale data efficiently. You will also be involved in ensuring the integration of data into cloud environments such as Azure, alongside basic DevOps tasks and RDBMS fundamentals.

Responsibilities:

  • Develop and maintain ETL pipelines using Python for data extraction, transformation, and loading.
  • UtilizeApache Sparkfor big data processing to handle large datasets and optimize performance.
  • Work with cloud technologies, particularlyAzure, to deploy and integrate data solutions.
  • Implement key Python concepts and leverage libraries/packages like Pandas, NumPy, and others for data manipulation.
  • Perform data integration tasks involving various data sources and structures.
  • Collaborate with cross-functional teams to design and implement robust, scalable data solutions.
  • Applybasic DevOpspractices to manage and automate workflows within the ETL process.
  • Ensure best practices in database management and integration withRDBMSsystems.
  • Participate in troubleshooting, optimization, and performance tuning of data processing systems.

Required Skills and Experience:

  • Proficient in Pythonwith hands-on experience in key libraries (Pandas, NumPy, etc.) and a deep understanding of Python programming concepts.
  • Solid experience inBig Data ProcessingusingApache Sparkfor large-scale data handling.
  • Basic DevOpsknowledge and familiarity with CI/CD pipelines for automating workflows.
  • Understanding ofAzure Fundamentalsand cloud data solutions.
  • Strong understanding ofRDBMS database fundamentals(SQL, relational data modelling, etc.).
  • Previous experience in ETL development and data integration.
  • Senior/Lead level experience with hands-on development in relevant technologies.
  • Excellent problem-solving skills and ability to optimize data workflows.

Additional Desirable Skills:

  • Familiarity with cloud-based data storage and processing technologies in Azure.
  • Experience working in Agile or other collaborative development environments.

#J-18808-Ljbffr

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers

Tips for Staying Inspired: How Data Science Pros Fuel Creativity and Innovation

Data science sits at the dynamic intersection of statistics, computer science, and domain expertise, driving powerful innovations in industries ranging from healthcare to finance, and from retail to robotics. Yet, the daily reality for many data scientists can be a far cry from starry-eyed talk of AI and machine learning transformations. Instead, it often involves endless data wrangling, model tuning, and scrutiny over metrics. Maintaining a sense of creativity in this environment can be an uphill battle. So, how do successful data scientists continue to dream big and innovate, even when dealing with the nitty-gritty of data pipelines, debugging code, or explaining results to stakeholders? Below, we outline ten practical strategies to help data analysts, machine learning engineers, and research scientists stay inspired and push their ideas further. Whether you’re just starting out or looking to reinvigorate a long-standing career, these pointers can help you find fresh sparks of motivation.

Careers

Top 10 Data Science Career Myths Debunked: Key Facts for Aspiring Professionals

Data science has become one of the most sought-after fields in the tech world, promising attractive salaries, cutting-edge projects, and the opportunity to shape decision-making in virtually every industry. From e-commerce recommendation engines to AI-powered medical diagnostics, data scientists are the force behind innovations that drive productivity and improve people’s lives. Yet, despite the demand and glamour often associated with this discipline, data science is also shrouded in misconceptions. Some believe you need a PhD in mathematics or statistics; others assume data science is exclusively about machine learning or coding. At DataScience-Jobs.co.uk, we’ve encountered a wide array of myths that can discourage talented individuals or mislead those exploring a data science career. This article aims to bust the top 10 data science career myths—providing clarity on what data scientists actually do and illuminating the true diversity and inclusiveness of this exciting field. Whether you’re a recent graduate, a professional looking to pivot, or simply curious about data science, read on to discover the reality behind the myths.

Careers

Global vs. Local: Comparing the UK Data Science Job Market to International Landscapes

How to evaluate salaries, opportunities, and work culture in data science across the UK, the US, Europe, and Asia Data science has proven to be more than a passing trend; it is now a foundational pillar of modern decision-making in virtually every industry—from healthcare and finance to retail and entertainment. As the volume of data grows exponentially, organisations urgently need professionals who can transform raw information into actionable insights. This high demand has sparked a wave of new opportunities for data scientists worldwide. In this article, we’ll compare the UK data science job market to those in the United States, Europe, and Asia. We’ll explore hiring trends, salary benchmarks, and cultural nuances to help you decide whether to focus your career locally or consider opportunities overseas or in fully remote roles. Whether you’re a fresh graduate looking for your first data science position, an experienced data professional pivoting from analytics, or a software engineer eager to break into machine learning, understanding the global data science landscape can be a game-changer. By the end of this overview, you’ll be better equipped to navigate the expanding world of data science—knowing which skills and certifications matter most, how salaries differ between regions, and what to expect from distinct work cultures. Let’s dive in.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.