Big Data Lead (07/05/2025)

Hirewand
London
1 week ago
Applications closed

Related Jobs

View all jobs

Lead Data Developer

Lead Data Engineer (AD -Consulting) - Exclusive

Data Scientist

Lead Reporting and Data Analyst

Geospatial Data Engineer

Senior Data Architect - Databricks

Job Type: Contract Job Location: Wimbledon , UK JobDescription: For this role, senior experience of Data Engineeringand building automated data pipelines on IBM Datastage & DB2,AWS and Databricks from source to operational databases through tocuration layer is expected using the latest cloud moderntechnologies where experience of delivering complex pipelines willbe significantly valuable to how to maintain and deliver worldclass data pipelines. Knowledge in the following areas essential: -Databricks: Expertise in managing and scaling Databricksenvironments for ETL, data science, and analytics use cases. - AWSCloud: Extensive experience with AWS services such as S3, Glue,Lambda, RDS, and IAM. - IBM Skills: DB2, Datastage, Tivoli WorkloadScheduler, Urban Code - Programming Languages: Proficiency inPython, SQL. - Data Warehousing & ETL: Experience with modernETL frameworks and data warehousing techniques. - DevOps &CI/CD: Familiarity with DevOps practices for data engineering,including infrastructure-as-code (e.g., Terraform, CloudFormation),CI/CD pipelines, and monitoring (e.g., CloudWatch, Datadog). -Familiarity with big data technologies like Apache Spark, Hadoop,or similar. - ETL/ELT tools and creating common data sets acrosson-prem (IBMDatastage ETL) and cloud data stores - Leadership &Strategy: Lead Data Engineering team(s) in designing, developing,and maintaining highly scalable and performant datainfrastructures. - Customer Data Platform Development: Architectand manage our data platforms using IBM (legacy platform) &Databricks on AWS technologies (e.g., S3, Lambda, Glacier, Glue,EventBridge, RDS) to support real-time and batch data processingneeds. - Data Governance & Best Practices: Implement bestpractices for data governance, security, and data quality acrossour data platform. Ensure data is well-documented, accessible, andmeets compliance standards. - Pipeline Automation &Optimisation: Drive the automation of data pipelines and workflowsto improve efficiency and reliability. - Team Management: Mentorand grow a team of data engineers, ensuring alignment with businessgoals, delivery timelines, and technical standards. - Cross CompanyCollaboration: Work closely with all levels of business stakeholderincluding data scientists, finance analysts, MI andcross-functional teams to ensure seamless data access andintegration with various tools and systems. - Cloud Management:Lead efforts to integrate and scale cloud data services on AWS,optimising costs and ensuring the resilience of the platform. -Performance Monitoring:Establish monitoring and alerting solutionsto ensure the high performance and availability of data pipelinesand systems to ensure no impact to downstream consumers.#J-18808-Ljbffr

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Jobs

Data Science Jobs at Newly Funded UK Start-ups: Q3 2025 Investment Tracker

Data science has become an indispensable cornerstone of modern business, driving decisions across finance, healthcare, e-commerce, manufacturing, and beyond. As organisations scramble to capitalise on the insights their data can offer, data scientists and machine learning (ML) experts find themselves in ever-higher demand. In the UK, which has cultivated a robust ecosystem of tech innovation and academic excellence, data-driven start-ups continue to blossom—fuelled by venture capital, government grants, and a vibrant talent pool. In this Q3 2025 Investment Tracker, we delve into the newly funded UK start-ups making waves in data science. Beyond celebrating their funding milestones, we’ll explore the job opportunities these investments have created for aspiring and seasoned data scientists alike. Whether you’re interested in advanced analytics, NLP (Natural Language Processing), computer vision, or MLOps, these start-ups might just offer the career leap you’ve been waiting for.

Jobs

Portfolio Projects That Get You Hired for Data Science Jobs (With Real GitHub Examples)

Data science is at the forefront of innovation, enabling organisations to turn vast amounts of data into actionable insights. Whether it’s building predictive models, performing exploratory analyses, or designing end-to-end machine learning solutions, data scientists are in high demand across every sector. But how can you stand out in a crowded job market? Alongside a solid CV, a well-curated data science portfolio often makes the difference between getting an interview and getting overlooked. In this comprehensive guide, we’ll explore: Why a data science portfolio is essential for job seekers. Selecting projects that align with your target data science roles. Real GitHub examples showcasing best practices. Actionable project ideas you can build right now. Best ways to present your projects and ensure recruiters can find them easily. By the end, you’ll be equipped to craft a compelling portfolio that proves your skills in a tangible way. And when you’re ready for your next career move, remember to upload your CV on DataScience-Jobs.co.uk so that your newly showcased work can be discovered by employers looking for exactly what you have to offer.

Jobs Careers

Data Science Job Interview Warm‑Up: 30 Real Coding & System‑Design Questions

Data science has become one of the most sought‑after fields in technology, leveraging mathematics, statistics, machine learning, and programming to derive valuable insights from data. Organisations across every sector—finance, healthcare, retail, government—rely on data scientists to build predictive models, understand patterns, and shape strategy with data‑driven decisions. If you’re gearing up for a data science interview, expect a well‑rounded evaluation. Beyond statistics and algorithms, many roles also require data wrangling, visualisation, software engineering, and communication skills. Interviewers want to see if you can slice and dice messy datasets, design experiments, and scale ML models to production. In this guide, we’ll explore 30 real coding & system‑design questions commonly posed in data science interviews. You’ll find challenges ranging from algorithmic coding and statistical puzzle‑solving to the architectural side of building data science platforms in real‑world settings. By practising with these questions, you’ll gain the confidence and clarity needed to stand out among competitive candidates. And if you’re actively seeking data science opportunities in the UK, be sure to visit www.datascience-jobs.co.uk. It’s a comprehensive hub featuring junior, mid‑level, and senior data science vacancies—spanning start‑ups to FTSE 100 companies. Let’s dive into what you need to know.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.