Jobs

Data Engineer


Job details
  • StarTech.com-manuela
  • London
  • 4 months ago
Applications closed

We are seeking a skilled and experienced Data Engineer with in-depth knowledge on data processing, data modelling, and data products for integration and visualization to join our Customer Insights & Analytics team at StarTech.com

Reporting to the Manager, Business Intelligence and Data Engineering, the Data Engineer will focus primarily on data engineering, data architecture and data management processes. This role is critical in enabling the organization to leverage data effectively for decision-making and strategic initiatives by ensuring the availability, reliability, and quality of data.

What you will be responsible for:

Designing and implementing data pipelines to extract, transform, and load (ETL) data from various sources into storage systems (e.g., data warehouses, data lakes). This involves understanding the data sources, defining data extraction methods, and ensuring the integrity and quality of the data throughout the process. Integrating data from multiple sources and systems to create a unified view of the data landscape within the organization. This involves understanding data formats, protocols, and APIs to facilitate seamless data exchange and interoperability between systems. Developing algorithms and scripts to clean, preprocess, and transform raw data into a format suitable for analysis and reporting. This may involve data normalization, denormalization, aggregation, and other data manipulation techniques. Designing data models and schemas to represent the structure and relationships of the data stored in databases. This involves understanding the business requirements and data usage patterns to design models that support efficient data access and analysis. Implementing data quality checks and validation processes to ensure the accuracy, completeness, and consistency of the data. This includes identifying and resolving data anomalies, errors, and discrepancies to maintain data integrity and reliability. Documenting data engineering processes, workflows, and systems to facilitate knowledge sharing and collaboration within the Data and Analytics team and across the organization, including creating documentation for data pipelines, data models, and infrastructure configurations. Providing day-to-day support and technical expertise to both technical and non-technical teams. Assisting with optimizing the infrastructure and resources required to support data processing and analysis, including servers, clusters, storage systems, and cloud services. Collaborating with the IT organization to ensure data security, compliance, and governance standards are consistently met across the data platform, adhering to global data engineering standards and principles. Assisting with creating, documenting, and improving repeatable patterns for accessing specific data sources, such as: repeatable playbook for consuming 3rd party APIs.

Essential Qualifications:

At least 2+ years post degree experience with design, implementation, and operationalization of large-scale data and analytics solutions. Strong background in technology with experience in data engineering, data warehousing and data product development. Strong knowledge base of modern data lakehouse technologies (e.g. Microsoft Fabric, Databricks, etc.). Experience with Azure Data Lake, Azure Data Factory. Knowledge of Spark, Spark SQL, PySpark. Experience using Python for Data Engineering. Strong ability to build relationships, work collaboratively, and resolve problems. Willingness to embrace new, improved and unconventional ways to address business and technical issues and opportunities. Ownership of what is being worked on as well as willingness to take credit, accept and learn from failures when applicable. Ability to adapt to a fast-paced, dynamic work environment. Self-motivated, ability to take direction and work independently.

Benefits& Perks:

Comprehensive Benefit Plan and RRSP Matching Competitive Vacation Policy Fitness Subsidy Training and Development Program Paid Charity Day and Regular Company Fun Events StarTech.com Product Discount Bonus Plan

About us

We are in the business of human-centered experiences starting with yours. We believe delivering on our promise of "hard-to-find, made easy" begins with an employee experience founded in opportunity, teamwork, empowerment, and curious minds always asking what if. Not only does our commitment to the exceptional deepen relationships with our partners and customers, it also ignites connection within our team.

Born and raised in London, Ontario, Canada and now taking on the world, we are a vibrant and growing tech company with a proven track-record of success. StarTech.com makes it easy for IT professionals around the globe to identify, find, get and use the hard-to-find connectivity parts they need to enable and enhance their technology solutions.

Operating in 26 countries globally, we are proud to be included as one of Canada's Best Managed Companies for 2023 and for the 13th consecutive year. In 2022, StarTech.com was proud to be included in Financial Post's FP500, a ranking of Canada's largest corporations based on revenue. We are honoured to be named by Kincentric in 2019 as one of Canada’s “Best Employers” as well as “one of Canada’s fastest growing companies” for a ninth year in a row by “Profit 500”.

StarTech.com is an Equal Opportunity Employer. In accordance with the Accessibility for Ontarians with Disabilities Act, 2005 and the Ontario Human Rights Code, StarTech.com will provide accommodations throughout the recruitment, selection and/or assessment process to applicants with disabilities. If selected to participate in the recruitment, selection and/or assessment process, please inform Human Resources of the nature of any accommodation(s) that you may require in respect of any materials or processes used to ensure your equal participation.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer

Are you a Data Engineer who loves to experiment and brings empathy and creativity to your work?Then you’ll fit right in at this people-first, agile tech company. Where collaboration, creativity and a shared commitment to a continuous improvement drives it’s success.Guided by core values – Empathise, Enable, Empower, and Experiment...

Bishopsgate

Data Engineer - Azure - Altrincham - £70k

Data Engineer - Azure - Hybrid - Manchester - £70kThis is a fantastic opportunity for a data engineer to join an expanding IT consultancy based in Manchester! If you are an expert in the MS Azure tech stack, experienced overseeing a team of data professionals and building ETL pipelines, this...

Wilmslow

Data Engineer

Your new roleAs a Data Engineer, you will be working on multiple projects, including the design and implementation, gathering data and integrating into existing model for extension. You will have experience of SSIS, MS SQL, Datawarehouse and cubes. Power BI experience preferred.Whilst this role doesn't involve Azure, there are upcoming...

Coventry

Data Engineer

Data EngineerPermanentLocation: Home / Crawley (3 days a week on site)Salary: £75,000 - £85,000 (+ benefits)Skills: SQL, Postgre SQL, CockroachDB, Docker, Flyway, SC ClearanceWe are looking to recruit an SC Cleared Data Engineer for a leading software & solutions organisation. The Data Engineer will rive data enablement that underpins cutting-edge...

Crawley

Data Engineer

Contract Data Engineer (6 Months) - Azure Azure, Azure Functions, ADF, Azure databricks, PowerBi  We are seeking an experienced Data Engineer for a 6-month contract to design, develop, and deploy scalable, secure Azure solutions. This role offers the opportunity to work on cutting-edge cloud technologies and contribute to key business...

Northampton

Data Engineer

Data EngineerPermanentLocation: Home / Brighton (on site 6 days a month)Salary: £50,000 - £60,000 (+ excellent benefits including 28% employer pension contributions, + bonus)Skills: Cloud Data Platforms (Azure preferred), SQL, Azure Data Factory, AgileWe are looking to recruit a Data Engineer for a technology driven public sector organisation based in...

Brighton