AWS, ETL, PYTHON, LABDA, GLUE
A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling client towards their full potential whilst driving meaningful change is seeking to add a Senior Data Engineer to the team based in London.
Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and SQL. Capability in scripting, data extraction via APIs, and the composition of SQL queries. Practical experience in integrating data engineering components into production systems, along with expertise in data cleaning, data wrangling, data visualisation, and reporting. Proficiency in handling substantial volumes of structured and unstructured data, including the integration of data through AWS and Azure cloud-based ingestion and curation processes. Knowledge of data mining, machine learning, and natural language processing is considered an advantage. Familiarity with Agile methodologies and participation in Scrum ceremonies. Competence in the design and construction of solutions tailored for the AWS and Azure cloud environments, which may involve expertise in Platform-as-a-Service components, serverless architecture, and container technologies. Experience working on the strategy to build out a capability Experience training of junior members of the team Strong leadership experience £65,000 - £75,000 10% Bonus
AMC/JMR/SDEN