Description

Key Skills:

Solid Hands-on experience with Azure Databricks - Pyspark coding and Spark SQL coding- Must have Solid Hands-on experience with Delta Lake House with Delta tables - Must have Solid Hands-on experience with Data warehousing - Must have Solid Hands-on experience with Azure Data Factory - Must haveCI/CD Pipelines Integrations - Must have Lead all the technical conversation with client and team coordination 10+ Years of experience with Data Project London Insurance market data experience

Responsibilities:

·Hand-on experience in Azure dataplatform architecture and developing data engineering pipelines

·Experience in working with both SQLand NoSQL databases.

·Hand-on experience in developing datasolutions using Azure Data platform tools( Azure data lake gen2,Azure Sql,Azure Data Factory , Mapping Dataflows , Azure Databricks , logic app, AzureSynapse ,Azure Analysis Services and Azure Functions).

·Strong knowledge and experience indata lake and delta lake-based data platform development using Azure Databricksand Azure Synapse Analytics .

·Strong experience with at least one ofthe programming languages: Python, PySpark, Scala, R.

·Able to develop CI/CD pipelines forautomated build and deploy

·Should be able to contribute totechnical solutions and must be able to translate functional/technical intocode, unit test and deliver to customer

·Experience with different databasetechnologies (., SQL database(s), Azure SQL)

·Strong Analytical & problem-solving skills

·Development, code review, unittesting, 

·Participation in Agileceremonies 

·Good communication skill

·Insurance knowledge will be addedadvantage