Senior/Lead Data Engineer

Who we Are

Recursion is an institutionally-backed startup currently in beta mode that is redefining business intelligence and automation with agentic AI. Our mission is to deliver non-obvious insights tailored specifically to each business and to automate complex processes beyond the capabilities of traditional RPA tools. By consolidating all data into a single source of truth and making it accessible in real-time via natural language conversations, we empower enterprises to make quick, confident decisions without delays in data processing or preparation. 

About the Role

The Data Engineer will design and maintain ETL pipelines for our clients, ensuring efficient ingestion, transformation, and storage of data. This person will play a key role in transforming various client’s data in the format most suitable for AI agents.

Key Responsibilities:

• Design, develop, and maintain scalable ETL pipelines to ingest, transform, and store data tailored to individual client requirements.
• Implement efficient data processing workflows for structured and unstructured data.
• Develop processes for raw data ingestion, transformation, and storage.
• Automate the generation of master data views on a regular basis.
• Collaborate with data analysts and app development teams for seamless data flow.
• Monitor and optimize data pipeline performance.

Qualifications:

• A minimum of 5 years of experience in a professional data engineering role.
• Expertise in ETL tools and frameworks (e.g., Apache Airflow, AWS Glue).
• Proficiency in Python, SQL, and cloud services (AWS, GCP, or Azure).
• Familiarity with data warehousing and transformation techniques.
• Strong debugging and performance optimization skills.
• Experience with real-time data processing frameworks.
• Knowledge of machine learning pipelines and integration.
• Familiarity with data visualization tools (e.g., Tableau, Looker, or Power BI).
• Background in working with APIs and integrating external data sources.
• Ownership: Track record of driving and delivering complete, high quality solutions to problems independently.
• Experience mentoring junior team members.

How to Apply

Please submit your resume and a brief cover letter explaining your interest in the role and how your experience aligns with the responsibilities and qualifications.