Jobs

Data Engineer


Job details
  • Clear Business
  • Sale
  • 2 weeks ago

Clear Business are looking for someone who is passionate about data, able to weave together traditional and emerging technologies by applying innovative thinking to deliver business priorities for reporting and insights, whilst strengthening our internal knowledge, skills, and capability.

As a Data Engineer, you will play a vital role in developing and maintaining our data infrastructure, pipelines, and systems. You will be responsible for integrating data from various sources, ensuring its quality, and making it available for analysis and reporting. This role offers an exciting opportunity for someone with a strong technical background and a passion for data to contribute to our organization's data-driven initiatives.

We are going through an exciting transition in the Data & Insight team as we transition from a legacy on-premises to a cloud base data lake as well as enabling the business to make empowered data driven decisions. Data is a key differentiator for Verastar and this is a fantastic opportunity to help shape our future success

Responsibilities of therole 

  • Design, develop, and maintain scalable data pipelines and ETL processes to support the collection, processing, and storage of data from diverse sources.

  • Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions, ensuring alignment with business objectives.

  • Implement data models and schemas to support business needs, ensuring data integrity, performance, and scalability.

  • Optimize data storage and retrieval processes for improved performance, reliability, and cost-effectiveness.

  • Work with stakeholders to identify opportunities for automation and optimization of data processes, driving efficiency and innovation.

  • Ensure compliance with data governance and security standards, implementing best practices for data handling and access control.

  • Stay updated on industry trends and emerging technologies in data engineering, continuously learning and applying new tools and techniques to improve our data infrastructure and processes.

Success Measures

  • Successfully design and implement scalable data pipelines and ETL processes that meet business requirements and performance goals.

  • Collaborate effectively with cross-functional teams to deliver timely and accurate data solutions that enable informed decision-making.

  • Demonstrate strong problem-solving skills and attention to detail in troubleshooting data issues and optimizing data processes.

  • Adhere to data governance and security standards, ensuring data integrity, confidentiality, and compliance with regulatory requirements.

  • Contribute to a culture of continuous improvement by actively seeking opportunities to enhance our data infrastructure and processes.

Experience

  • 2+ years of experience in a data-focused role, with a proven track record of designing, implementing, and maintaining data pipelines and ETL processes.

  • Strong technical background with expertise in database concepts, SQL, data modeling, and data integration techniques.

  • Experience with programming languages such as Python, Java, or Scala, as well as data processing frameworks like Apache Spark.

  • Familiarity with cloud platforms and services, such as AWS, Azure, or Google Cloud, and proficiency in deploying and managing data solutions in a cloud environment.

  • Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.

  • Bachelor's degree in Computer Science, Engineering, or related field is preferred.

Skills 

  • Communication skills (data). know how to communicate to and between technical and non-technical stakeholders as well as facilitate discussions within a multidisciplinary team, with potentially difficult dynamics. You can advocate for the team externally. You know how to manage different perspectives.

  • Data analysis and synthesis. know how to undertake data profiling and source system analysis and can present clear insights to colleagues to support the end use of the data.

  • Data development process. You can design, build and test data products that are complex or large-scale. You know how to build teams to complete data integration services.

  • Data innovation. You understand the impact of emerging trends on the organisation in data tools, analysis techniques and data usage.

  • Data integration design. You know how to select and implement the appropriate technologies to deliver resilient, scalable and future-proofed data solutions.

  • Data modelling. You understand the concepts and principles of data modelling and can produce relevant data models across multiple subject areas. You know how to reverse-engineer data models from a live system. You understand industry-recognised data modelling patterns and standards and when to apply them. You can compare and align different data models.

  • Metadata management. You can design an appropriate metadata repository and present changes to existing metadata repositories. You understand a range of tools for storing and working with metadata. You can provide oversight and advice to more inexperienced members of the team.

  • Problem resolution (data). You know how to respond to problems in databases, data processes, data products and services as they occur. You can initiate actions, monitor services and identify trends to resolve problems. You can determine the appropriate remedy and assist with implementation of it as well as preventative measures.

  • Programming and build (data engineering). You know how to use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations. You can collaborate with others to review specifications where appropriate.

  • Technical understanding (data engineering). You understand core technical concepts and can apply them with guidance.

  • Testing. You can review requirements, specifications and define test conditions. You can identify issues and risks associated with work while being able to analyse and report test activities and results.

Qualificationsand other requirements

  • Academic qualifications in data/ analytics/ engineering and/ or work experience in a relevant data role.

  • Demonstrable understanding of data integration and engineering. 

  • Strong working experience with SQL and python. Understanding of databricks 

  • Experience in the Microsoft Azure suite advantageous.

  • Experience with data governance and security standards is desirable.

  • Ability to work effectively in a fast-paced and collaborative environment.

In return for your hard work, you’ll get

It takes all kinds of people to make Clear Business the success that we are, and we’ve got a range of benefits to make sure everyone is happy.

  • Pension contributions and life assurance coverage.
  • Generous discounts at numerous high street and online retailers.
  • 25 days of annual leave, increasing to 28 days based on tenure.
  • Enjoy your birthday off every year.
  • Ability to purchase up to 10 additional holidays and sell up to 5 days per year.
  • Cycle to work and travel loans for people wanting a greener commute.
  • Comprehensive well-being support, including round-the-clock access to a GP, mental health assistance, fitness programs, and complimentary legal and financial advice.

The important extras

  • Hybrid working model: the choice to work remotely for three days.
  • Engage in charity fundraising and volunteering activities as part of our giving back initiative.
  • Enjoy fantastic on-site amenities including a complimentary gym, free parking, a subsidized café, and an on-site bar for post-work drinks, quiz nights, and social gatherings.
  • Full time/Permanent contract of 37.5 hours per week.
  • No weekends and every bank holiday off.

What happens next

If you’re looking for a new challenge with great benefits at an award-winning company, then Clear Business is the place for you. To be part of our continued success click ‘Apply’ today to take the next step in your career.

Across Clear Business, we’re passionate about creating an inclusive team and celebrating our diversity. We want talented people with great skills and matching values to join our teams.

All successful candidates will be subject to pre-employment checks.

#LI-KT1

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer

Data EngineerFully remote workingSalary up to £55,000 per annum+ BenefitsAn exciting new opportunity has arisen to join a large retailer, known for their sustainability ethos within a Data Engineer role. The company are based in the midlands and the position is FULLY REMOTE.Key responsibilities:Ensure quality data is ingested into the...

Eden Smith Group Staffordshire

Data Engineer - 60k

Data Engineer – £60kWant to join one of the most recognisable real estate agencies in London and work on their data platform?Want to receive the training needed to follow the CEO’s footsteps from an entry level role to the top of the company?As part of the digital and project department,...

Saragossa London

Data Engineer

Shape the future of impactful community data solutions.Work with cutting-edge technology like Azure, Databricks, and Terraform.Fully remote role (UK Based) with development opportunities and meaningful projects.OverviewAre you a data engineer with a passion for building robust pipelines and scalable infrastructure? We’re working with a dynamic community donation platform making real...

ADLIB Recruitment | B Corp Leeds

Data Engineering Manager

Data Engineering Manager – Wealth Management FirmA leading international wealth management firm with an outstanding track record of success is seeking a Data Engineering Manager to play a pivotal role in its data strategy. This is an exciting opportunity to drive innovation by leading data engineering efforts, including designing architecture...

Lawrence Harvey London

Data Engineer

Data Engineer - 6 month contract - Outside IR35Hybrid - LondonA transformation consultancy are looking for a Data Engineer to work on updates an advertising platform.You must have experience working on Low Latency platforms(High volume data, real time data streams, low latency and high availability)The project is to update an...

Plan A Digital London

Data Engineer

Data EngineerContract Duration: 6 Months initiallyLocation: London (Hybrid working model - 2 days in the office)Job Type: ContractInside IR35 (Day Rate £500-550 DOE)Join a prestigious project with a historic organisation as a Data Engineer. This role involves managing outputs, processes, application, and performance reporting for a key project divided into...

Reed Professional Services London