Lead Data Engineer - Financial Services - London
Job Summary
- London
- Permanent
- BBBH779820
- Apr 16, 2021
- £100k - £120k
Job Description
Lead Data Engineer opportunity to work on a cloud data lake project. This is a hands of role but as the team grows there will be opportunity to manage a team.
Opportunity to work with as a lead data engineer with a financial services firm who are working on an AWS data lake transformation.
Role responsibilities:
- Responsible for the build of data flows, end to end data pipeline.
- Responsible for the delivery of real-time serverless data pipelines built on AWS technologies.
- Management and wind-down or data pipelines built on existing infrastructures as we migrate to Cloud environments.
- Collaborate with other tech teams to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering, and machine learning.
Experience required:
- Strong programming experience with Python or Scala
- Substantial experience working with cloud technologies, ideally AWS.
- Demonstrated strength in data modelling, ETL development, and data warehousing.
- Experience using big data technologies (Hadoop, Hive, Hbase, Spark etc.)
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large datasets.
Morgan McKinley is acting as an Employment Agency and references to pay rates are indicative.
BY APPLYING FOR THIS ROLE YOU ARE AGREEING TO OUR TERMS OF SERVICE WHICH TOGETHER WITH OUR PRIVACY STATEMENT GOVERN YOUR USE OF MORGAN MCKINLEY SERVICES.
