Jobs

Data Engineer


Job details
  • Russell Tobin
  • London
  • 7 months ago
Applications closed

Responsibilities:

  • Collaborate with stakeholders and product managers to build and recommend appropriate data requirements.
  • Data transformation: Identify data sources and build advanced code to extract, transform and load different sources of data using query languages, programming languages and tools to create the necessary processes to generate the required data products.
  • Data management: Collaborate with the team to find opportunities to optimize data tools and platforms ( Azure, AWS) or proprietary tools.
  • Data Ops: Manage the life cycle of products developed to ensure the integrity and continuity of developed processes through CI/CD.
  • Data visualization: Create and manage dashboards.

Qualifications:

  • Bachelor’s degree in computer science or equivalent area
  • 4+ years of experience in IT, data engineering roles or cloud engineering oriented to data.
  • Knowledgeable in application development process and in principles to organize, orchestrate and deploy projects into the cloud environment and related tools (GitHub, JFrog, Docker)
  • Knowledge of data ops processes (GitHub actions, GitLab, etc). Managing the continuous deployment and integration of ETLs and processes created, to ensure the quality of the life cycle of products.
  • Strong knowledge of python for data engineering. Focus on frameworks for data manipulation processes, APIs, QA libraries, cloud integration libraries and automation.
  • Strong knowledge of databases (cloud managed), both analytical and OLTP. Capable of building complex queries and designing database schemas to solve application requirements.
  • Knowledge of data-oriented cloud services in AWS or Azure. Understanding of hosting APIs to receive data, deploying ETLs using cloud native tools (Power BI, Data Factory, Azure SQL, Synapse, Glue, Lambda, etc.), hosting docker images and implementing frameworks to integrate different services into ETLs (Secrets Manager, Lambda, Event Bridge, ECR, etc.)
  • Strong knowledge of data visualization tools (Power BI, Tableau, Qlick, etc.). Capable of building complex dashboards to allow users to easily interact with the data.
  • Familiarity with Terraform would be a great plus.
  • Passion in learning technologies balanced with pragmatic approaches to implementations.
  • Strong command of English language (both verbal and written)

Education:         

  • Bachelor's degree in quantitative field like Computer Science, Engineering, Statistics, Mathematics or related field required. Advanced degree is a strong plus

Rate/Salary: 400

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer

Role Title: Data EngineerDuration: 6 MonthsLocation: Hybrid - TelfordTelford 2 days on siteRate: £500 - Umbrella onlyClearance Level: SC clearance is mandatoryWould you like to join a global leader in consulting, technology services and digital transformation?Our client is at the forefront of innovation to address the entire breadth of opportunities...

Telford

Data Engineer - London / Hybrid - £70,000

My client is based in the London area are currently looking to recruit for an experienced Data Engineer to join their team. They are one of the leaders within the Legal Industry, and are currently going through a period of growth and are looking for an experienced Data Engineer to...

City of London

Data Engineer – Google Cloud Platform, GCP

Data Engineer – Google Cloud Platform, GCPContract: 12 Months - 56292Rate: £315 per Day (Inside IR35)Location: Essex offices (near Basildon) and Hybrid 4 days a weekOne of the world’s most advanced engineering companies and a household name is seeking a Data Engineer to work in its Global Data Analytics and...

Basildon

Data Engineer / Warehouse Developer - £70,000 - Hybrid - London

Data Engineer / Data Warehouse Developer - £55,000 - £70,000 - Hybrid - LondonCompany Overview:My client, an established wealth management company is currently hiring for a Data Engineer / Data Warehouse Developer. They are a multinational cooperation who have been experts in their field for over 60 years, with the...

City of London

Data Engineer (Snowflake)

A well-known financial services company are looking for a Data Engineer with Snowflake experience to join their growing Data Engineering team in London - this is a permanent role with hybrid working arrangements, split roughly 50/50 between home and the office.In this role you will be working within a new,...

City of London

Data Engineer

Job Title: Data EngineerSalary: up to £65,000 (depending on experience)Working Arrangement: HybridKey Responsibilities:· Build a Database from scratch using SQL· Develop and manage imaging data· Orchestrate data workflows and pipelines.· Optimize and manage databases and data warehouses.· Implement data transformation workflows.· Collaborate with Software Engineering Team and other stakeholders to...

Bath