My client is a market-leading payments technology company head quartered in the US. Due to continued success, they are looking for an experienced Senior Data Engineer to join their Data Analytics team.
Excellent Benefits: Bonus, Pension, Healthcare, Life Cover, Income Protection, Dental & Vision
- Join a dynamic data, reporting, and analytics team actively engaged in building and testing a cutting-edge platform to generate insightful, data-driven solutions.
- Analyze, interpret, and orchestrate complex data from diverse sources, encompassing unstructured, semi-structured, and structured datasets in both streaming and batch modes.
- Collaborate closely with data consumers to deliver meaningful metrics that drive informed decision-making.
- Contribute to the establishment of standards for data producers (application or business teams) streaming data into the Data Lake.
- Provide vital support throughout the application lifecycle, including quality assurance, user acceptance testing, and post-release phases.
- Actively participate in peer code reviews to maintain code quality and foster continuous improvement.
You will have:
- 5+ years of proven expertise in software enterprise-level Data Engineering.
- Strong proficiency in SQL with a demonstrated ability to work with large datasets.
- Comprehensive knowledge of cloud platforms.
- Domain expertise in Big Data workloads, including experience with data lakes and relational database design and best practices.
- Hands-on experience in designing and developing Spark data pipelines.
- A solid understanding of the evolving data landscape and cloud-based big data workloads.
- Proficient in ETL/ELT patterns, contributing to efficient and scalable data workflows.
- Expertise in managing data lakes and familiarity with source code management systems.
- Practical experience in Agile methodologies such as Scrum, facilitating effective collaboration and rapid delivery.