Sr. Software/Data Engineer, Autonomy (Databricks/Pipelines)

Rivian
London
2 months ago
Applications closed

About Rivian
Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract.
As a company, we constantly challenge what’s possible, never simply accepting what has always been done. We reframe old problems, seek new solutions and operate comfortably in areas that are unknown. Our backgrounds are diverse, but our team shares a love of the outdoors and a desire to protect it for future generations.
Role Summary
We're hiring a high-impact Senior Software/Data Engineer to join our Autonomy Data, Tools and ML Infra Team. Your main focus will be to build and scale our analytics data platform and pipelines using Databricks.
Our data platform processes petabytes of telemetry data from the vehicle fleet, enabling the Autonomy team to triage issues, calculate metrics and perform analysis
We are expanding the team because our data volumes will grow rapidly as we produce more vehicles and launch more sophisticated autonomy features.
Your insights and improvements will be instrumental in providing accurate and up-to-date data for all our analysis and evaluation activities. Your work will directly influence the development of our software for millions of miles of real-world driving.
Responsibilities

  • Develop and scale our data analytics pipelines in Databricks to handle data from our growing vehicle fleet and our vehicle simulation.
  • Establish and operationalize performance monitoring systems for our data pipelines. Collaborate with stakeholders to refine SLAs as the monitoring matures.
  • Proactively design and deliver impactful architectural improvements to ensure the platform's long-term stability.
  • Design and implement data governance mechanisms that enable us to balance secure and wider collaboration with an uncompromised development process.
  • Contribute to the continuous development of tooling (e.G., Cursor and MCP servers) to increase developer velocity and integrate with Rivian systems.
  • Collaborate closely with colleagues in our offices in California and Serbia, acting as a key technical liaison to gather requirements and drive improvements to the platform.
  • Demonstrate strong organizational skills to manage multiple projects, meet deadlines, and deliver high-quality results.
  • Support the team’s on-call rotation for any operationally critical systems.

Qualifications

  • 5+ years of professional software/data engineering experience, with a significant focus on data engineering or analytics.
  • Proficiency in building, testing, and optimizing production-grade data pipelines in Databricks, using Spark (PySpark/Scala) and SQL.
  • Strong Python and SQL skills.
  • Hands-on experience developing dashboards for analysis and reporting, leveraging tools such as Databricks Workspaces, Streamlit or Jupyter notebooks.
  • Familiarity with workflow orchestration tools (e.G. Apache Airflow) or data transformation frameworks (e.G. dbt) a plus.
  • Familiarity with autonomous systems development (e.G., perception, planning, control) or relevant domains such as robotics, simulation, or verification/validation.
  • Proven ability to debug and root-cause issues systematically.

Equal Opportunity
Rivian is an equal opportunity employer and complies with all applicable federal, state, and local fair employment practices laws. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, sex, sexual orientation, gender, gender expression, gender identity, genetic information or characteristics, physical or mental disability, marital/domestic partner status, age, military/veteran status, medical condition, or any other characteristic protected by law.
Rivian is committed to ensuring that our hiring process is accessible for persons with disabilities. If you have a disability or limitation, such as those covered by the Americans with Disabilities Act, that requires accommodations to assist you in the search and application process, please email us at .
Candidate Data Privacy
Rivian may collect, use and disclose your personal information or personal data (within the meaning of the applicable data protection laws) when you apply for employment and/or participate in our recruitment processes (“Candidate Personal Data”). This data includes contact, demographic, communications, educational, professional, employment, social media/website, network/device, recruiting system usage/interaction, security and preference information. Rivian may use your Candidate Personal Data for the purposes of (i) tracking interactions with our recruiting system;
(ii) carrying out, analyzing and improving our application and recruitment process, including assessing you and your application and conducting employment, background and reference checks;
(iii) establishing an employment relationship or entering into an employment contract with you;
(iv) complying with ourlegal, regulatory and corporate governance obligations;
(v) recordkeeping;
(vi) ensuring network and information security and preventing fraud;
and (vii) as otherwise required or permitted by applicable law.
Rivian may share your Candidate Personal Data with (i) internal personnel who have a need to know such information in order to perform their duties, including individuals on our People Team, Finance, Legal, and the team(s) with the position(s) for which you are applying;
(ii) Rivian affiliates;
and (iii) Rivian’s service providers, including providers of background checks, staffing services, and cloud services.
Rivian may transfer or store internationally your Candidate Personal Data, including to or in the United States, Canada, the United Kingdom, and the European Union and in the cloud, and this data may be subject to the laws and accessible to the courts, law enforcement and national security authorities of such jurisdictions.
Please note that we are currently not accepting applications from third party application services.

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

How Many Data Science Tools Do You Need to Know to Get a Data Science Job?

If you’re trying to break into data science — or progress your career — it can feel like you are drowning in names: Python, R, TensorFlow, PyTorch, SQL, Spark, AWS, Scikit-learn, Jupyter, Tableau, Power BI…the list just keeps going. With every job advert listing a different combination of tools, many applicants fall into a trap: they try to learn everything. The result? Long tool lists that sound impressive — but little depth to back them up. Here’s the straight-talk version most hiring managers won’t explicitly tell you: 👉 You don’t need to know every data science tool to get hired. 👉 You need to know the right ones — deeply — and know how to use them to solve real problems. Tools matter, but only in service of outcomes. So how many data science tools do you actually need to know to get a job? For most job seekers, the answer is not “27” — it’s more like 8–12, thoughtfully chosen and well understood. This guide explains what employers really value, which tools are core, which are role-specific, and how to focus your toolbox so your CV and interviews shine.

What Hiring Managers Look for First in Data Science Job Applications (UK Guide)

If you’re applying for data science roles in the UK, it’s crucial to understand what hiring managers focus on before they dive into your full CV. In competitive markets, recruiters and hiring managers often make their first decisions in the first 10–20 seconds of scanning an application — and in data science, there are specific signals they look for first. Data science isn’t just about coding or statistics — it’s about producing insights, shipping models, collaborating with teams, and solving real business problems. This guide helps you understand exactly what hiring managers look for first in data science applications — and how to structure your CV, portfolio and cover letter so you leap to the top of the shortlist.

The Skills Gap in Data Science Jobs: What Universities Aren’t Teaching

Data science has become one of the most visible and sought-after careers in the UK technology market. From financial services and retail to healthcare, media, government and sport, organisations increasingly rely on data scientists to extract insight, guide decisions and build predictive models. Universities have responded quickly. Degrees in data science, analytics and artificial intelligence have expanded rapidly, and many computer science courses now include data-focused pathways. And yet, despite the volume of graduates entering the market, employers across the UK consistently report the same problem: Many data science candidates are not job-ready. Vacancies remain open. Hiring processes drag on. Candidates with impressive academic backgrounds fail interviews or struggle once hired. The issue is not intelligence or effort. It is a persistent skills gap between university education and real-world data science roles. This article explores that gap in depth: what universities teach well, what they often miss, why the gap exists, what employers actually want, and how jobseekers can bridge the divide to build successful careers in data science.