Cloud ETL Engineer

Description

Transform Data at Scale with AWS – Lead the Future of Cloud ETL

Are you a Cloud ETL Engineer with expertise in AWS and data transformation? In this role, you will be instrumental in driving the modernisation of a public sector data platform, ensuring the efficient and accurate processing of large-scale data in a cloud-based environment. Your work will involve designing and optimising ETL workflows, integrating data pipelines, and ensuring data integrity. This is an excellent opportunity to contribute to an impactful project and work with the latest cloud technologies. If you’re ready to take your expertise to the next level, apply today!

Key Responsibilities

ETL Design & Development:
Design and implement ETL workflows to process structured data from Oracle databases, applying transformation rules as specified by business and data analysts.
Data Transformation & Cleaning:
Apply data transformation and cleaning logic, ensuring data integrity, accuracy, and adherence to defined retention policies.
Cloud Integration:
Integrate ETL jobs into a cloud data pipeline, ensuring seamless interaction with cloud-based storage and processing services, specifically within AWS.
Optimisation & Error Handling:
Optimise ETL jobs for performance, scalability, and error handling to ensure smooth and efficient data processing.
Collaboration:
Work closely with Cloud Data Engineers and other team members to ensure ETL workflows integrate smoothly with overall cloud data infrastructure and meet project objectives.
Monitoring & Troubleshooting:
Continuously monitor ETL workflows, troubleshoot issues, and resolve performance or reliability concerns, ensuring high availability and reliability of data pipelines.

Experience:
3+ years of hands-on experience in ETL workflow development and optimisation.
Proficiency with AWS services like Glue, Lambda, and S3.
Strong programming skills in Python, SQL, or similar languages.
Solid understanding of Oracle database structures and cloud data processing.
Experience in data cleaning, transformation, and enforcing retention policies.

Desirable Qualifications

AWS Certified Data Analytics or Solutions Architect certification.
Familiarity with large-scale data warehouses in cloud environments.
Experience integrating ETL workflows with data engineering pipelines.

Outside IR35 role and Remote

BPSS Clearance: Required (or willingness to undergo process)

We’re excited to see how your experience can contribute to this role. Please send us your CV for further discussion.

ASA Recruitment is one of Scotland’s largest independent multi-sector recruitment agencies. We specialise in providing effective tailored solutions for permanent, contract and temporary employment requirements for our Clients and Candidates. We are members of the REC and are ISO certified.

YOU SEEK WE FIND