We have an exciting job opportunity forAWSData Engineerrole atTelford, UK - Permanent.

Title:AWS Data Engineer

Location:Telford, UK

Duration:Permanent

Job Description:

• Design, develop, and maintain Real Time data streaming pipelines using AWS Kinesis for processing and analysing high-velocity data streams.
• Collaborate with stakeholders to gather requirements and design efficient data streaming architectures for Real Time analytics, monitoring, and alerting.
• Build and optimize Kinesis Data Streams, Kinesis Data Firehose, and Kinesis Data Analytics to process Real Time data from various sources.
• Develop and implement ETL processes to transform, enrich, and aggregate streaming data for downstream consumption in data lakes or data warehouses such as AWS S3, Redshift, and DynamoDB.
• Integrate Kinesis with other AWS services like Lambda, S3, and EMR for Real Time data ingestion, processing, and storage.
• Optimize streaming applications for performance and scalability, ensuring efficient resource usage and minimal latency.
• Develop and maintain robust error handling, data validation, and retry mechanisms within Kinesis pipelines to ensure data consistency and reliability.
• Implement security best practices for data streaming, including enc...