Pyspark/SQL Developer – Automation/SQL/PySpark – sought by leading investment bank based in London – Hybrid – Contract
*inside IR35 – umbrella*
Key Responsibilities:
Develop, maintain, and optimize PySpark data processing pipelines. Automate data extraction, transformation, and loading (ETL) processes. Collaborate with data engineers and analysts to design and implement data solutions. Perform data analysis and generate reports to support business decision-making. Ensure data quality and integrity throughout the data lifecycle. Troubleshoot and resolve data processing and reporting issues.Qualifications:
Bachelor's degree in Computer Science, Engineering, or a related field. Proven experience as a Python Developer, with a focus on data processing and automation. Strong proficiency in PySpark and Apache Spark. Solid understanding of SQL and relational databases. Experience with version control systems (e.g., Git). Excellent problem-solving skills and attention to detail. Strong communication and teamwork abilities.The latest news, articles, and resources, sent to your inbox weekly.
Senior Data Engineer - Python / Data Pipelines / Data Platform / AWS - is required by fast growing, highly successful and tech focused organisation.About the jobYou will play a crucial role in designing, building, and maintaining their data platform, with a strong emphasis on streaming data, cloud infrastructure, and...
Cramlington
Senior Data Engineer - Remote - £60kExciting opportunity for an experienced cloud data engineer to join an expanding data team who are using data in an exciting and advanced way. They will support your learning and development from a technical and leadership perspective as you help them design, build and...
Newcastle upon Tyne
We are looking fora passionate Python backend developer to join our team at LR OneOcean.You will be responsible for developing, implementing and maintaining high-quality software for our Vessel Position Service solution, working on big data in the maritime industry, using cutting-edge programming features and frameworks and collaborating with other teams...
Lloyd's Register London
Data Engineer - London - Hybrid - £70,000 - £80,000 + BenefitsCompany Overview:My client is a modern data consultancy that empowers data-driven organisations to realise the full value of its partnered technologies such as Amazon Web Services (AWS), Snowflake and more! They provide consulting and managed services in data engineering,...
City of London
Senior Data Engineer – Edinburgh or London (Hybrid)£70,000 - £120,000 + Bonus & BenefitsAI Connect are partnering with a retail bank to help them appoint a Senior Data Engineer. You’ll join a major Data Engineering capability with a number of peers who can support your development across a modern tech...
AI Connect Edinburgh
Reporting to the Principal Solutions Architect, the Lead Data Engineer is a senior role in our analytics department. the Purpose of the role is to build modern, cloud based data pipelines which enable the delivery of data used by internal & external stakeholders, and to play a leading role in...
Michael Page Stockport
