Jobs

Senior Cloud/Data Engineer


Job details
  • Rapid7
  • Belfast
  • 3 months ago
Applications closed

Senior Cloud Engineer


Rapid7 seeks an experienced, highly driven, and dynamic Senior Cloud Engineer to take our data engineering function to the next level. Come and join our efforts in unlocking the value of data through industry-leading innovation, cutting edge modern tooling, democratization at scale and building exceptional and trusted data products for the company! 

About the Team
As we spearhead a cultural shift to a data-driven business, Data Engineering serves as the Hub for all teams at Rapid7 from ML Ops, to Sales and Operations to Platform and Engineering. Our team is a highly skilled yet egoless group of data magicians (and humorists) with a penchant for innovation and a knack for problem solving. 

About the Role

As a Senior Cloud Engineer, you will build and maintain data infrastructure within the Data Engineering team's data platform. You’ll be responsible for managing containerized applications and supporting our product event streaming systems in the cloud as you partner with high impact teams such as AI and Product Analytics. You will also build data pipelines using tools such as Airflow, Python, ECS and Snowflake. The Senior Data Engineer will also be expected to drive and mature best practices such as IAC (Terraform) and DevOps within the Data Engineering team. 

In this role, you will:

Build and maintain hosted environments for key tools with AWS ECS/EKS

Manage cloud environments for the data engineering team through Terraform

Support our product events data architecture including Kafka, SQS, EKS &, S3

Develop data pipelines with Fivetran, Snowflake & Airflow using languages such as Python, SQL & Javascript

Provide thought leadership and contribute to the vision of our data engineering function 

Participate in team processes such as on-call rotations, bug triage, technical direction, standards, and execution 

Own delivery architecture/execution of major component(s) from conception to release

Looked up to for technical mentorship within the data engineering team. Make others better through code reviews, focus on documentation, and technical guidance

Understand the tradeoffs between technical and business needs, interact and negotiate with key stakeholders, and deliver solutions that take all of these needs into account 

Regularly take complex designs / codebases and simplify them without being asked

Work closely with leadership to drive adoption of the latest DevOps and DataOps trends and technologies.

The skills you’ll bring include:

5+ years of hands-on software engineering experience 

4+ years working with a major cloud provider (preferably AWS); Experience building/maintaining VPC’s and deploying code using Terraform is a must!

3+ years building and maintaining hosted environments and applications using EKS or another container service is a must!

5+ years of experience in at least one programming language such as Python, Java, Scala is required (Python is our most commonly used language); Advanced SQL expertise is required

Experience working in a modern lakehouse is required (Snowflake is preferred); Modern warehousing best practices should be second nature

Cloud experience is required (AWS is strongly preferred); Terraform is highly preferred

Knowledge and ideally hands on experience working with container services is required (ECS, Kubernetes, etc)

Experience working in a mature SDLC environment (ie: CICD) is required 

Modern tech stack experience is a plus (dbt, Fivetran, Snowflake. Airflow)

Experience as a leader within a data engineering team and ability to mentor teammates 

Strong work ethic, resiliency, persistence, and urgency; Data Engineering holds itself to a high standard so you’ll need to keep up!

Sharp business and interpersonal skills; ability to influence at senior levels across business units to drive change and achieve common goals

BS or MS in Computer Science, Analytics, Statistics, Informatics, Information Systems or
another quantitative field or equivalent experience 


We know that the best ideas and solutions come from multi-dimensional teams. That’s because these teams reflect a variety of backgrounds and professional experiences. If you are excited about this role and feel your experience can make an impact, please don’t be shy - apply today.
 

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Cloud/Data Engineer

Senior Cloud EngineerRapid7 seeks an experienced, highly driven, and dynamic Senior Cloud Engineer to take our data engineering function to the next level. Come and join our efforts in unlocking the value of data through industry-leading innovation, cutting edge modern tooling, democratization at scale and building exceptional and trusted data...

Rapid7 Belfast

Senior Data Engineer

SENIOR DATA ENGINEER- GOOGLE CLOUDHYBRID WORKING - MUST BE BASED IN SOUTH EAST UK£565 PER DAY - OUTSIDE IR35Our client is a leading MSP, who is working with some of the UK's largest and most well-known organisations and due to continued success and client wins, they are looking to expand...

Sectech Solutions

Senior Data Engineer - London - £85,000

Senior Data Engineer - London - £85,000I am looking for a Senior Data Engineer to join a well-known and successful organisation to deliver on a variety of data driven projects. The business is looking for someone to add a level of expertise to their team of Data Engineers and you...

City of London

Senior Data Engineer - Remote - £60k

Senior Data Engineer - Remote - £60kExciting opportunity for an experienced cloud data engineer to join an expanding data team who are using data in an exciting and advanced way. They will support your learning and development from a technical and leadership perspective as you help them design, build and...

Newcastle upon Tyne

Senior Data Architect

We believe in the power of ingenuity to build a positive human future.As strategies, technologies, and innovation collide, we create opportunity from complexity.Our diverse teams of experts combine innovative thinking and breakthrough technologies to progress further, faster. Our clients adapt and transform, and together we achieve enduring results.We are over...

PA Consulting London

Senior Cloud Engineer

GCP Senior Cloud EngineerHybrid - Leeds - office 1 day per weekSalary - CompetitiveOur client is on a mission to create environments in which them and their customers can be successful, delivering value through secure, lean, automated operations whilst looking for opportunities for innovation. Continuously improving through open, honest feedback...

Get Staffed Online Recruitment Leeds