Senior Data Engineer (ETL,ELT) – Banking – Brussels
Day rate: €600 – €800
Duration: 6 – 12 months
Start: ASAP
My banking client is looking for a Senior Data Engineer to join on a freelance mission. They want someone who can you autonomously craft, develop and deploy data pipelines, making sure these pipelines are filled with qualitative data which serve as an input for our machine learning engineers.
In this role, You collaborate closely with our machine learning engineers and/or cloud architects on projects, always with a quality focused, end-to-end approach. You will support the reporting teams in the data exploration and data preparation phases, Implement data quality controls. You will liaise with IT infrastructure teams to address infrastructure issues and to ensure that the components and software used on our different platforms are all consistent.
As a senior Data engineer you will also build and share knowledge with your junior colleagues.
Job requirements
Candidates must be based in either Belgium, France, The Netherlands or the UK (IR35 check needed).
The Skills
Experience with analysis and creation of data pipelines, data architecture, ETL/ELT development and with processing structured and unstructured data, including post-go live activities Ability to analyse data, identify issues ( gaps, inconsistencies) and you can solve them Experience using data stored in RDBMSs and experience or some understanding of NoSQL databases You have knowledge of Scala and Spark, and a good understanding of the Hadoop ecosystem including Hadoop file formats like Parquet and ORC You can write performant Scala code and SQL statements and can design modular, future proof solutions that are fit for purpose You are autonomous in working on IBM Mainframe & Unix based systems. You have a true agile approach, capable and willing to tackle tasks outside of their strengths to help the team Experience in working with customers to identify and clarify requirements Strong curiosity about FINTECH and technologies related data. You have good communication skills!
Nice to haves
Knowledge of Cloudera, IBM mainframe You speak English fluently, any other language is a plus!