Data Engineer
As Senior Data Engineer you will work closely with the Associate Director of Data Platforms and Architecture to deliver
Amaysims data engineering strategy.
You will be responsible for developing and maintaining the data engineering, data processing, and data storage solutions
that enable effective data analytics and business intelligence.
Lead, strategise, and drive improvements that align with Amaysims long-term goals, acting as a bridge between technical
teams and business units, ensuring that the data architecture supports and enhances business outcomes.
You will be key in designing, building and optimising Amaysims data pipelines. You will support Data Architecture, Data &
Analytics and other internal customers on data initiatives and ensure optimal data delivery architecture is consistent
throughout ongoing projects, working autonomously and making decisions collaboratively, within a team that will support
and challenge you as you grow and develop.
You will be a leader within the Data Platforms & Architecture team, mentoring and leading a team of Data Engineers.
Key Accountabilities
Leadership- Lead and mentor a team of data engineers, providing guidance, support, and professional development
- Oversee data engineering projects from inception to completion, ensuring timely delivery and alignment with
- Work closely with cross-functional teams, including data scientists, analysts, and business leaders, to understand
- Contribute to the strategic planning of data initiatives, aligning them with the company's goals and objectives.
Technical:
- Design, build, and maintain scalable and reliable data pipelines and architectures.
- Develop, optimise, and manage ETL/ELT processes to ensure efficient data flow and transformation.
- Integrate data from various sources, including databases, APIs, and third-party systems, ensuring data
- Utilise cloud platforms (e.g., AWS, Azure, Google Cloud) for data storage, processing, and analytics.
- Establish and enforce data quality standards, monitoring data integrity and resolving data-related issues.
- Develop and maintain automated workflows and processes to streamline data engineering tasks and improve
- Ensure data security and compliance with relevant regulations and standards.
- Collaborate with data scientists and analysts to support data modelling, query development, and data
warehousing solutions.
Who are we looking for?
If you have some or all the below skills or experience, we want to hear from you:
- Previous experience working as a Senior Data Engineer
- Previous experience leading a team
- Cloud Data Architecture services: EC2, SQS, Lambda, Kinesis, Athena, Glue, S3
- SQL / NoSQL databases
- Implementing automated batch ETL within DWH tech stack
- API Integration
- SQL and Data modelling
- Shell Scripting
- Productivity Tools: Experience with productivity tools e.g. Slack, JIRA, Confluence
- Extensive experience and achievements working in Data Engineering and Warehousing.
- Experience with traditional Data Warehouse Architecture: Snowflake/Redshift/MS SQL Server/Oracle/MySQL
- Experience using and maintaining a Customer Data Platform
- Experience designing and implementing real time API streamed data pipeline (Kinesis Firehose)
- Transformation tools like DBT
- Understanding of Data science modelling
- Reporting tools like Tableau.
- Programming Languages: Python, nodejs, R
- Data Analytics: general statistical analysis skills
- OS: Mac, Linux (Ubuntu)