Jobs

Data Engineer


Job details
  • Lime Street Recruitment LTD
  • Ruislip
  • 3 days ago

As a Data Engineer you will collaborate with and support the Finance BI and global finance team in building our Data Warehouse. You'll be required to develop scalable data pipelines, extract data from core systems, transforming it and loading into database/warehouse tables while also ensuring these are optimised for maximum performance within the tools available. You are expected to have strong collaboration skills and be a high performer within the Finance BI team.ResponsibilitiesDesign and develop data transfer engines and pipelines: highly scalable, end-to-end processes to consume, integrate, and analyse data from different data sources.Perform data collection, cleansing, and integration for analytical needs.Optimise storage and retrieval processes for maximum performance and efficiency.Optimise data transfer engines and pipelines by monitoring, evaluating performance, and applying enhancement.Design and develop data marts and define data models.Participate in System Data Architecture and Data Governance activitiesAdhere to and take part in enhancement of data management standards, coding standards, guidelines, and policies.Employ strong engineering mind-set in design and development of automated monitoring, alerting, and recovery processes.Collaborate with Source System analysts, Business Intelligence developers, Architects and Stake holders to ensure that requirements for integration, security, quality, and cross functional usage are addressed.Help resolve data issues, troubleshoot system problems, and as needed, assist with reporting, debugging data accuracy issues, and other related functions.Work in a collaborative environmentmeetings, iterative development, and design and code review sessions.Collaborate with all technology and business functions to understand requirementsand produce clear specification and documentationImplement quality checks and troubleshoot issues to ensure data accuracy and reliability.Monitor and manage the performance of data systems.Stay updated on emerging technologies and trends in data engineering.Qualifications / Experience:3-5 years of experience as a Data Engineer or a similar role.Expert knowledge of data engineering tools and technologies (e.g. SQL, ETL, data warehousing).Proficiency in T-SQL (4+ years of SQL experience)4+ years of experience with schema design and dimensional data modellingProficiency in the Microsoft BI Tool Stack; Database, SSIS, SSAS, PowerBI (Nice to Have)Experience with Azure cloud platform and Azure Data FactoryKnowledge of data modeling, database design, and data governance.Experience with Continuous Integration Processes and Tools (AzureDevOps)Experience with Change Management Processes and Cycles (Release and Deployment)Experience with Microsoft SQL Data Tools (2019+)Experience in working in Development Teams and Team Collaborative tools (Jira or similar)Minimum bachelors degree in Computer Science, Data Engineering, Information Technology, or a related field.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer - Senior/Lead

Xpertise is seeking a series of Data Engineers with cloud experience to join a fledgling team in Newcastle. As part of the company's growing engineering division, you will play a pivotal role in leading the data engineering capabilities, working closely with Platform Engineers, Developers, and Analysts.Key details:Salary: £(phone number removed)...

Newcastle upon Tyne

Data Engineer (Contract)

Data Engineer (Contract)We have a requirement for a Data Engineer to join our client based in Leicester on an initial 4-month contract. My client is a Financial Services company, who specialise in Pension Solutions.Details:Data Engineer (Data Warehouse)4 months (initial contract)Hybrid Remote (Leicester)£400/day (Outside IR35)Key responsibilities:Design, develop, and deliver robust ETL...

Leicester

Data Engineer (Contract)

Data Engineer (Contract)An established Renewable Energy company based in Manchester are currently on the lookout for a Data Engineer to help them on an internal project on an initial 6-month contract.If you have experience working within the Energy / Utilities sector this will be an advantage.Details:Data Scientist6 months (initial contract)Hybrid...

Manchester

Data Engineer - Azure Migrations, SQL, SSIS– London Hybrid

Data Engineer - Azure, SQL, SSIS, Cloud Migrations – London 1 day / weekI’m working with an exceptional Data Analytics Consultancy in London to recruit an experienced Data Engineer to join their growing team working on client data transformations. In this role, you will be responsible for designing, implementing, and...

London

Data Engineer - London - AWS - 60,000 + Benefits

Data Engineer - London - AWS - Up to 60,000 + BenefitsExciting opportunity to work with a forward thinking company who offer their employers the chance to work with cutting edge tech, grow their skills with fully-costed training programs, maintain a healthy work-life balance with modern working arrangements - up...

City of London

Data Engineer - London - GCP - £60,000 + Benefits

Data Engineer - London - GCP - Up to £60,000 + BenefitsDo you want to work with cutting edge technology? Grow or develop your skills in AI? - A space that could soon dominate the industry. All while working for a company who value your well-being as well as your...

City of London