Data Engineer - Technical Intelligence

Workable
gb
1 month ago
Applications closed

Related Jobs

View all jobs

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Data Engineer

Who are we?

IOG, is a technology company focused on Blockchain research and development. We are renowned for our scientific approach to blockchain development, emphasizing peer-reviewed research and formal methods to ensure security, scalability, and sustainability. Our projects include decentralized finance (DeFi), governance, and identity management, aiming to advance the capabilities and adoption of blockchain technology globally.

We invest in the unknown, applying our curiosity and desire for positive change to everything we do. By fueling creativity, innovation, and progress within our teams, our products and services are designed for people to be fearless, to be changemakers.

What the role involves:

As a Data Engineer, you are part of the Technical Intelligence (TechInt) team. The team’s main function is to recon the blockchain industry and feed the company with new trends and projects. The TechInt team has automatized the recon process by utilizing a data lake and machine learning. The team currently harvests data from a variety of different sources. This data gets fed into different systems that then show this data as a report.

You are responsible for maintaining and setting up data solutions and services. A key part would be to aid in the maturation of the data ingestion pipeline and processes. Moreover, you would be expected to create a state-of-the-art data warehouse which would be cloud-native. In your daily job, you do a mix of data engineering, and cloud infrastructure management. 

  • Develop and maintain automated data ingestion (API or crawling) pipelines from source code repositories, social media, and on-chain analytics. 
  • Simplify existing data pipelines - re-architecting where necessary.
  • Research existing datasets to figure out their relevance - and remove irrelevant data pipelines and sources.
  • Design a data warehouse that can be queried by analysts and APIs, and that will serve as a data backend for a reporting web application.
  • Collaborate with data scientists to operationalize ML models and deploy them into production environments.
  • Work closely with leadership to understand and define requirements, ensuring alignment with the department’s strategy and roadmap.
  • Collaborate with a Data Scientist and an Intelligence Engineer to implement technical solutions that meet project goals.
  • Ensure systems are functional, available, and carefully monitored for continuous performance and reliability.

Requirements

Who you are:

  • Minimum 3–4 years of hands-on recent experience with AWS cloud services :
  • Knowledge of Infrastructure as code (such as Terraform, AWS CloudFormation, Python AWS CDK).
  • Knowledge of cloud services management in AWS (such as S3, Redshift, Lambda, Batch, Glue, Athena etc.).
  • Hands-on experience with Docker for containerizing data applications.
  • Knowledge of relational databases and writing highly optimized SQL, including data transformations, complex joins, and performance tuning.
  • Strong proficiency in Python programming, including PySpark for data transformation.
  • Ability to communicate well both verbally and in writing, with both technical and non-technical partners. Professional English.

It would be beneficial if you have the following:

  • BSc/MSc in a Computer Science field, or equivalent practical experience. 
  • Knowledge of big data processing platforms (such Databricks) and data manipulation libraries in Python (such as Pandas, Polars).
  • Knowledge of docker container orchestration (such as Kubernetes, ECS).
  • Knowledge of Continuous Integration and Continuous Delivery (CI/CD) pipelines (such as GitHub Actions, Travis, Jenkins).
  • Knowledge of blockchain on-chain data representation.

Are you an IOGer?

Do you find yourself questioning the status quo? Do you tinker with ideas and long to turn those ideas into solutions? Are you able to spark thoughtful debates, bringing out the inquisitiveness in others? Does the promise of continuously growing excite you? Then get ready to reimagine everything you thought wasn’t possible because that’s what it means to be an IOGer - we don’t set limits, we break them. 

Benefits

  • Remote work
  • Laptop reimbursement
  • New starter package to buy hardware essentials (headphones, monitor, etc)
  • Learning & Development opportunities
  • Competitive PTO 

At IOG, we value diversity and always treat all employees and job applicants based on merit, qualifications, competence, and talent. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Portfolio Projects That Get You Hired for Data Science Jobs (With Real GitHub Examples)

Data science is at the forefront of innovation, enabling organisations to turn vast amounts of data into actionable insights. Whether it’s building predictive models, performing exploratory analyses, or designing end-to-end machine learning solutions, data scientists are in high demand across every sector. But how can you stand out in a crowded job market? Alongside a solid CV, a well-curated data science portfolio often makes the difference between getting an interview and getting overlooked. In this comprehensive guide, we’ll explore: Why a data science portfolio is essential for job seekers. Selecting projects that align with your target data science roles. Real GitHub examples showcasing best practices. Actionable project ideas you can build right now. Best ways to present your projects and ensure recruiters can find them easily. By the end, you’ll be equipped to craft a compelling portfolio that proves your skills in a tangible way. And when you’re ready for your next career move, remember to upload your CV on DataScience-Jobs.co.uk so that your newly showcased work can be discovered by employers looking for exactly what you have to offer.

Data Science Job Interview Warm‑Up: 30 Real Coding & System‑Design Questions

Data science has become one of the most sought‑after fields in technology, leveraging mathematics, statistics, machine learning, and programming to derive valuable insights from data. Organisations across every sector—finance, healthcare, retail, government—rely on data scientists to build predictive models, understand patterns, and shape strategy with data‑driven decisions. If you’re gearing up for a data science interview, expect a well‑rounded evaluation. Beyond statistics and algorithms, many roles also require data wrangling, visualisation, software engineering, and communication skills. Interviewers want to see if you can slice and dice messy datasets, design experiments, and scale ML models to production. In this guide, we’ll explore 30 real coding & system‑design questions commonly posed in data science interviews. You’ll find challenges ranging from algorithmic coding and statistical puzzle‑solving to the architectural side of building data science platforms in real‑world settings. By practising with these questions, you’ll gain the confidence and clarity needed to stand out among competitive candidates. And if you’re actively seeking data science opportunities in the UK, be sure to visit www.datascience-jobs.co.uk. It’s a comprehensive hub featuring junior, mid‑level, and senior data science vacancies—spanning start‑ups to FTSE 100 companies. Let’s dive into what you need to know.

Negotiating Your Data Science Job Offer: Equity, Bonuses & Perks Explained

Data science has rapidly evolved from a niche specialty to a cornerstone of strategic decision-making in virtually every industry—from finance and healthcare to retail, entertainment, and AI research. As a mid‑senior data scientist, you’re not just running predictive models or generating dashboards; you’re shaping business strategy, product innovation, and customer experiences. This level of influence is why employers are increasingly offering compensation packages that go beyond a baseline salary. Yet, many professionals still tend to focus almost exclusively on base pay when negotiating a new role. This can be a costly oversight. Companies vying for data science talent—especially in the UK, where demand often outstrips supply—routinely offer equity, bonuses, flexible work options, and professional development funds in addition to salary. Recognising these opportunities and effectively negotiating them can have a substantial impact on your total earnings and long-term career satisfaction. This guide explores every facet of negotiating a data science job offer—from understanding equity structures and bonus schemes to weighing crucial perks like remote work and ongoing skill development. By the end, you’ll be well-equipped to secure a holistic package aligned with your market value, your life goals, and the tremendous impact you bring to any organisation.