Jobs

Senior Data Engineer


Job details
  • BI, Big Data & Analytics
  • Penrith
  • 8 months ago
Applications closed

Senior Data Engineer opportunity to join a well-known financial services company working on a Remote first basis (once a month in the office on average).

Senior Data Engineer - Remote First (offices in lake district) - Up to £65,000 + Great Benefits

Purpose of Job

Advise on and ensure the maximum return of value from the company's data assets; through use of best practice data engineering techniques that aid the delivery of the company's data management strategy and roadmap and align to regulatory requirements.

Contribute towards the support, maintenance, and improvement of the company's platform inc data pipelines, and ensure data quality and governance.

Responsibilities

Advise on the Design, implementation, and maintenance of complex data engineering solutions. Ensure the implementation, and maintenance of complex data engineering solutions to acquire and prepare data and that it adheres to Best Practice. (Extract, Transform, Load) Contributes towards and ensures the delivery of the creation and maintenance of data pipelines to connect data within and between data stores, applications, and organisations. Contributes towards and ensures the delivery of complex data quality checking and remediation. Identifying data sources, data processing concepts and methods Evaluating, designing and implementing on-premise, cloud-based and hybrid data engineering solutions Structuring and storing data for uses including - but not limited to - analytics, machine learning, data mining, sharing with applications and organisations. Harvesting structured and unstructured data Integrating, consolidating, and cleansing data Migrating and converting data Applying ethical principles and regulatory requirements in handling data Ensuring appropriate storage of data in line with relevant legislation, and the company requirements. Guiding and contributing towards the development of junior & trainee Data Engineers. Providing Technical guidance to Data Engineers

Knowledge, Experience and qualifications

Excellent level of knowledge & experience in Azure Data, including DataLake, Data Factory, DataBricks, Azure SQL (Indicative experience = 5yrs+) Build and test processes supporting data extraction, data transformation, data structures, metadata, dependency and workload management. Knowledge on Spark architecture and modern Datawarehouse/Data-Lake/Lakehouse techniques Build transformation tables using SQL. Moderate level knowledge of Python/PySpark or equivalent programming language. PowerBI Data Gateways and DataFlows, permissions. Creation, utilisation, optimisation and maintenance of Relational SQL and NoSQL databases. Experienced working with CI/CD tooling such as Azure DevOps/GitHub including repos, source-control, pipelines, actions. Awareness of Informatica or similar data governance tools (Desirable) Experience of working in agile (SCRUM) and waterfall delivery-type teams. Experienced with Confluence & Jira. Experience in a financial services or other highly regulated environment. Any experience or interest in AI is desirable

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data Engineer

Senior Data EngineerSalary/Rate: £75,000 - £90,000 per annum + BonusLocation: North LondonCompany: RetelligenceAbout RetelligenceRetelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to deliver cutting-edge solutions....

Highbury

Senior Data Engineer

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on...

Nottingham

Senior Data Engineer

Senior Data Engineer - UK (Hybrid/Remote)🚀 Shape the Future of Data in a High-Growth Industry! 🚀I'm working with a fast-growing, market-leading company looking for a Senior Data Engineer to play a key role in developing their next-generation data platform. With rapid year-on-year growth and a commitment to innovation, this is...

London

Senior Data Engineer

Senior Data Engineer - Retail/eCommerce£50,000 - £70,000 DOE + 10% BonusSW LondonHybrid - 3 days per week in the officeOur client is an ambitious, fast-growing eCommerce business with a startup spirit and almost 20 years of successOperating primarily as a digital-first brand, they combine an entrepreneurial culture with a solid...

3Search London

Senior Data Engineer

Job Title: Senior Data EngineerLocation: London, UK (3 days in the office)SC Cleared: RequiredJob Type: Full-TimeExperience: 8+ yearsJob Summary:We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This...

Mastek London

Senior Data Engineer

Senior Data Engineer - 1 year fixed term contractAbout the TeamTheLexisNexis Intellectual Property (IP)division (https://www.lexisnexisip.com) provides international patent content and a suite of online and analytic tools that meet the evolving needs of the intellectual property market. We deliver data to support LexisNexis IP search and analytics applications, empowering our...

LexisNexis Intellectual Property Solutions London