Lead Data Engineer(Kakfa/Openshift)

Synechron
London
2 days ago
Create job alert

We are

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 16,500+, and has 60 offices in 20 countries within key global markets.


We are looking for Engineering Tech Leads with strong expertise in Data Engineering, OpenShift Telemetry, Kafka, Splunk, and LLM‑based observability. This role will lead the design and build of enterprise‑scale telemetry and observability platforms


Key Responsibilities:

  • Design, build, and optimize large‑scale OpenShift telemetry pipelines (metrics, logs, traces).
  • Develop Kafka-based streaming solutions—producers, consumers, schemas, and resilient data services.
  • Engineer multi‑tenant observability data models, ensuring lineage, quality, and SLA compliance.
  • Integrate enriched telemetry into Splunk for dashboards, alerting, analytics, and proactive insights (Observability Level 4).
  • Implement schema governance (Avro/Protobuf), versioning, and compatibility controls.
  • Build automated validation, replay, and backfill mechanisms for reliable data operations.
  • Standardize telemetry across platforms using OpenTelemetry for metrics, tracing, and logs.
  • Leverage LLMs to improve observability workflows—query assistance, anomaly summarization, and runbook automation.
  • Collaborate with SRE, platform, and application teams on telemetry integration, alerting, and SLOs.
  • Ensure security, compliance, RBAC, and encryption in all pipeline components.
  • Maintain clear documentation for data flows, schemas, dashboards, and operational guides.


Required Skills:

  • Strong hands‑on experience with Kafka (producers/consumers, schema registry, KSQL, Kafka Streams).
  • Deep understanding of OpenShift/Kubernetes telemetry, Prometheus, OpenTelemetry, and CLI tooling.
  • Experience integrating telemetry into Splunk (HEC, UF, sourcetypes, CIM) and creating dashboards/alerts.
  • Proficiency in Python or similar languages for ETL/ELT, enrichment, and validation workflows.
  • Solid experience with Avro/Protobuf/JSON schemas and compatibility best practices.
  • Knowledge of observability frameworks and ability to drive towards Level 4 maturity (proactive automation).
  • Understanding of multi‑cluster and hybrid cloud telemetry architecture.
  • Strong grounding in data security, RBAC, secrets management, and encryption.
  • Excellent communication, analytical thinking, and documentation skills.


S YNECHRON’S DIVERSITY & INCLUSION STATEMENT

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Related Jobs

View all jobs

Lead Data Engineer

Lead Data Engineer

Lead Data Engineer / Architect – Databricks Active - SC Cleared

Lead Data Engineer (Azure)

Lead Data Engineer

Lead Data Engineer

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Data Science Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Thinking about switching into data science in your 30s, 40s or 50s? You’re far from alone. Across the UK, businesses are investing in data science talent to turn data into insight, support better decisions and unlock competitive advantage. But with all the hype about machine learning, Python, AI and data unicorns, it can be hard to separate real opportunities from noise. This article gives you a practical, UK-focused reality check on data science careers for mid-life career switchers — what roles really exist, what skills employers really hire for, how long retraining typically takes, what UK recruiters actually look for and how to craft a compelling career pivot story. Whether you come from finance, marketing, operations, research, project management or another field entirely, there are meaningful pathways into data science — and age itself is not the barrier many people fear.

How to Write a Data Science Job Ad That Attracts the Right People

Data science plays a critical role in how organisations across the UK make decisions, build products and gain competitive advantage. From forecasting and personalisation to risk modelling and experimentation, data scientists help translate data into insight and action. Yet many employers struggle to attract the right data science candidates. Job adverts often generate high volumes of applications, but few applicants have the mix of analytical skill, business understanding and communication ability the role actually requires. At the same time, experienced data scientists skip over adverts that feel vague, inflated or misaligned with real data science work. In most cases, the issue is not a lack of talent — it is the quality and clarity of the job advert. Data scientists are analytical, sceptical of hype and highly selective. A poorly written job ad signals unclear expectations and immature data practices. A well-written one signals credibility, focus and serious intent. This guide explains how to write a data science job ad that attracts the right people, improves applicant quality and positions your organisation as a strong data employer.

Maths for Data Science Jobs: The Only Topics You Actually Need (& How to Learn Them)

If you are applying for data science jobs in the UK, the maths can feel like a moving target. Job descriptions say “strong statistical knowledge” or “solid ML fundamentals” but they rarely tell you which topics you will actually use day to day. Here’s the truth: most UK data science roles do not require advanced pure maths. What they do require is confidence with a tight set of practical topics that come up repeatedly in modelling, experimentation, forecasting, evaluation, stakeholder comms & decision-making. This guide focuses on the only maths most data scientists keep using: Statistics for decision making (confidence intervals, hypothesis tests, power, uncertainty) Probability for real-world data (base rates, noise, sampling, Bayesian intuition) Linear algebra essentials (vectors, matrices, projections, PCA intuition) Calculus & gradients (enough to understand optimisation & backprop) Optimisation & model evaluation (loss functions, cross-validation, metrics, thresholds) You’ll also get a 6-week plan, portfolio projects & a resources section you can follow without getting pulled into unnecessary theory.