Senior Data Engineer

Cognizant Technology Solutions
Nottingham
2 days ago
Create job alert

This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board.


Job Summary

We are seeking a Senior Data Engineer to lead the charge on ensuring the health, reliability, and security of our critical data pipelines. This is a senior, hands-on technical role for an expert who is comfortable with mission-critical batch data pipelines in a cloud environment, integrating with numerous real-time data sources. You will be responsible for managing highly sensitive and critical data streams and driving strategic initiatives to minimize incidents, optimize performance, and build a resilient hybrid data environment. Your focus will be on proactive problem-solving, automation, and continuous improvement, transforming our operational processes from reactive to resilient.


Key Responsibilities

  • Production Support & Reliability: Act as the subject matter expert and technical lead for resolving the most complex, high-impact incidents affecting data pipelines. Manage multiple stakeholders for critical events. Perform in-depth root cause analysis to prevent recurrence, focusing on data pipelines, scheduling platforms such as Control-M and AWS-related services.
  • Data Security & Governance: Ensure the integrity and security of highly sensitive and critical data throughout the entire pipeline. Implement and enforce security best practices, including managing encryption at rest and in transit, access controls, and compliance.
  • Automation & Tooling: Develop and implement automation for common operational tasks to reduce manual toil. Focus on building tools and monitoring solutions that provide visibility into the end-to-end health of pipelines.
  • Performance Optimization: Proactively analyse and tune the performance of batch schedules and AWS resource utilization. Identify and implement optimizations to improve efficiency and reduce operational costs.
  • Collaboration & Leadership: Act as a technical leader and mentor for both onsite and offshore team members. Ensure seamless collaboration, clear communication, and consistent operational standards across a distributed team. Contribute to the long-term technical strategy for data operations including modernization efforts.

Required Skills & Experience

  • Extensive, hands-on experience in a production support, site reliability, or data operations role within a large-scale data environment.
  • Experience with data distribution platforms (e.g. Ab Initio & Spark centric solutions like AWS Glue & EMR), including deep understanding of ETL/ELT workflows & integration into data platforms like Snowflake.
  • Extensive experience with scheduling platforms such as Control-M, including complex scheduling, dependencies, and managing a large batch environment.
  • Working knowledge of IBM Sterling FileGateway or similar file transfer (MFT) solutions would be beneficial (e.g. AWS Transfer Family).
  • Deep knowledge of AWS and its data-related services, including knowledge of open-source, cloud-first data-pipeline orchestration capabilities like Apache Airflow.
  • Proficiency in Shell scripting & Python for automation and system administration.
  • Proven ability to manage highly sensitive and critical data pipelines, with a strong understanding of security and compliance requirements.
  • Demonstrated experience working effectively with both onsite and offshore teams, ensuring seamless operational handoffs and knowledge sharing.
  • Excellent communication skills, with the ability to articulate complex technical issues to both technical teams and business stakeholders.
  • Experience with DevOps or DataOps principles and practices is essential.

Competencies

  • Persuasive Communication: Skillfully translate complex technical concepts into compelling narratives, using persuasive language and visual aids to appeal to a wide range of audiences. Continuously solicit and integrate feedback to refine and enhance communication strategies for maximum impact.
  • Ownership Mentality: Take responsibility for the quality and success of the work the team is leading, demonstrating a sense of pride and accountability.
  • Sound Judgement: Make sound technical decisions based on available information and trade-offs, considering both short-term and long-term implications.
  • Proactive Risk Identification: Anticipate and identify potential risks and challenges in projects, proposing mitigation strategies and proactively address them to ensure project success.
  • Cross-Domain Learning: Actively seek opportunities to expand technical knowledge and expertise beyond your primary domain, demonstrating a strong understanding of how different technologies and systems interact and integrate.
  • Analytical Thinking: Approach problems with a structured and analytical mindset, breaking them down into manageable components.
  • Technical Problem Solving: Lead troubleshooting efforts and resolve complex technical issues, mentoring others in problem-solving approaches.
  • Project/Feature Leadership: Take ownership of focused projects or complex features, leading them from design through implementation and delivery, while also providing guidance, support, and mentorship to others.
  • Cross-Functional Interaction: Collaborate effectively with other teams and functions, building relationships and fostering alignment to achieve shared objectives. Represent the team in cross-functional discussions and initiatives.

The Cognizant community:

We are a high caliber team who appreciate and support one another. Our people uphold an energetic, collaborative and inclusive workplace where everyone can thrive.



  • Cognizant is a global community with more than 300,000 associates around the world.
  • We don't just dream of a better way - we make it happen.
  • We take care of our people, clients, company, communities and climate by doing what's right.
  • We foster an innovative environment where you can build the career path that's right for you.

About us:

Cognizant is one of the world's leading professional services companies, transforming clients' business, operating, and technology models for the digital era. Our unique industry-based, consultative approach helps clients envision, build, and run more innovative and efficient businesses. Headquartered in the U.S., Cognizant (a member of the NASDAQ-100 and one of Forbes World's Best Employers 2025) is consistently listed among the most admired companies in the world. Learn how Cognizant helps clients lead with digital at www.cognizant.com


Cognizant is an equal opportunity employer. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other characteristic protected by federal, state or local laws.


Disclaimer: Compensation information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.


Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.


#J-18808-Ljbffr

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Anti-Piracy

Senior Data Engineer - Energy

Senior Data Engineer (2 days onsite in London)

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

What Hiring Managers Look for First in Data Science Job Applications (UK Guide)

If you’re applying for data science roles in the UK, it’s crucial to understand what hiring managers focus on before they dive into your full CV. In competitive markets, recruiters and hiring managers often make their first decisions in the first 10–20 seconds of scanning an application — and in data science, there are specific signals they look for first. Data science isn’t just about coding or statistics — it’s about producing insights, shipping models, collaborating with teams, and solving real business problems. This guide helps you understand exactly what hiring managers look for first in data science applications — and how to structure your CV, portfolio and cover letter so you leap to the top of the shortlist.

The Skills Gap in Data Science Jobs: What Universities Aren’t Teaching

Data science has become one of the most visible and sought-after careers in the UK technology market. From financial services and retail to healthcare, media, government and sport, organisations increasingly rely on data scientists to extract insight, guide decisions and build predictive models. Universities have responded quickly. Degrees in data science, analytics and artificial intelligence have expanded rapidly, and many computer science courses now include data-focused pathways. And yet, despite the volume of graduates entering the market, employers across the UK consistently report the same problem: Many data science candidates are not job-ready. Vacancies remain open. Hiring processes drag on. Candidates with impressive academic backgrounds fail interviews or struggle once hired. The issue is not intelligence or effort. It is a persistent skills gap between university education and real-world data science roles. This article explores that gap in depth: what universities teach well, what they often miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data science.

Data Science Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Thinking about switching into data science in your 30s, 40s or 50s? You’re far from alone. Across the UK, businesses are investing in data science talent to turn data into insight, support better decisions and unlock competitive advantage. But with all the hype about machine learning, Python, AI and data unicorns, it can be hard to separate real opportunities from noise. This article gives you a practical, UK-focused reality check on data science careers for mid-life career switchers — what roles really exist, what skills employers really hire for, how long retraining typically takes, what UK recruiters actually look for and how to craft a compelling career pivot story. Whether you come from finance, marketing, operations, research, project management or another field entirely, there are meaningful pathways into data science — and age itself is not the barrier many people fear.