Jobs

Tech Manager


Job details
  • Milton Keynes
  • 2 weeks ago

Job Description:
As a Tech Manager – Data Engineer with AWS experience , you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives.
Key Responsibilities:

  • Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion.
  • AWS Expertise: Utilize your expertise in AWS services such as Amazon EMR , S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions.
  • Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance.
  • Data Quality: Implement data quality and data governance best practices to maintain data integrity.
  • Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and storage solutions to ensure optimal performance.
  • Documentation: Create and maintain comprehensive documentation for data pipelines, architecture, and best practices.
  • Collaboration: Collaborate with cross-functional teams, including data scientists and analysts, to understand data requirements and deliver high-quality data solutions.
  • Automation: Implement automation processes and best practices to streamline data workflows and reduce manual interventions.
    Must have: AWS, ETL, EMR, GLUE, Spark/Scala, Java, Python,
    Good to have: Cloudera – Spark, Hive, Impala, HDFS , Informatica PowerCenter, Informatica DQ/DG, Snowflake Erwin
    Qualifications:
  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • 5 to 8 years of experience in data engineering, including working with AWS services.
  • Proficiency in AWS services like S3, Glue, Redshift, Lambda, and EMR.
  • Knowledge on Cloudera based hadoop is a plus.
  • Strong ETL development skills and experience with data integration tools.
  • Knowledge of data modeling, data warehousing, and data transformation techniques.
  • Familiarity with data quality and data governance principles.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and teamwork skills, with the ability to collaborate with technical and non-technical stakeholders.
  • Knowledge of best practices in data engineering, scalability, and performance optimization.
  • Experience with version control systems and DevOps practices is a plus

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

La Fosse | Head of Delivery (Data Function)

La Fosse is happy to announce that a longstanding client has engaged with us Exclusively to aid them in their search for a Head of Delivery on a contract basis.We’re looking for a Head of Delivery to come in and take the reigns of an ongoing Data Transformation Programme and...

La Fosse Sheffield

La Fosse | Head of Delivery (Data Function)

La Fosse is happy to announce that a longstanding client has engaged with us Exclusively to aid them in their search for a Head of Delivery on a contract basis.We’re looking for a Head of Delivery to come in and take the reigns of an ongoing Data Transformation Programme and...

La Fosse London

Engineering - Senior Backend Engineer - Insights (Scala)

We believe that everyone can and should automate the tools they use every day. The Tray Platform empowers anyone to do more faster by harnessing automation with the industry-leading, low-code general automation platform.With, citizen automators throughout organisations can easily automate complex processes through a powerful, flexible platform, and can connect...

tray.io London

Sales Manager - Low Carbon Tech

Help us make a big green dent in the universe.We're on a mission to drive the global renewable energy revolution, and to help us make our vision a reality.We're looking for an experienced Sales Manager who will be responsible for leading and improving our sales operations as we accelerate our...

Octopus Energy Brighton

Team Lead - Data Services

Data Services Team LeaderA hands on role leading & co-ordinating the day-to-day activities of team of data engineers. Ensuring efficient delivery of TFSUKs curated data. Actively participating in the prioritisation of work, projects & pipeline management. Supporting and contribution to the development of team members and the function, to deliver...

Toyota Financial Services, KINTO and KINTO JOIN Epsom

Head of Technology (Portfolio Management)- Thriving Software Development Start-Up

The RolePortfolio Management is responsible for all of this funds optimisation and allocation research along with monitoring fund performance and reviewing the quant process. As manager of the PM Tech team, you will be responsible for the simulation, analytics, and reporting infrastructure; for monitoring gearing, allocations and implementation shortfall; along...

Oxford Knight London