Data Engineer - Senior Level - Python and SQL - Direct Hire

You and your team will be responsible for designing, building, and maintaining robust systems and infrastructure for processing and analysing large and complex datasets. You will collaborate closely with data scientists, analysts, product managers, and other stakeholders to understand requirements and develop scalable solutions.

Role Responsibilities:

As a Data Engineer, you will play a crucial role in developing and maintaining data pipelines, data warehouses, and cloud-based systems. Your key responsibilities will include:

• Lead out the build of a new team in Manila: Lead efforts to recruit and mentor new team members in Manilla, fostering a collaborative attitude and high-performing team environment.
• Create performant batch and streaming data pipelines capable of handling large volumes of data in both real-time market data and batch formats (Apache Airflow, Apache Kafka, Apache Flink).
• Utilize tools like Snowflake to construct reliable and scalable data warehousing solutions.
• Employ Amazon Web Services (AWS) or Google Cloud Platform (GCP) to build robust and scalable cloud-based systems.
• Improve Continuous Integration/Continuous Deployment processes using tools like Jenkins and GitLab to automate development, testing, and deployment.
• Oversee the maintenance and monitoring of various data applications, pipelines, and databases.
• Participate in daily stand-ups and team meetings to coordinate and collaborate on development efforts.
• Interacting with stakeholders to create and build analytical products and services

Experience / Competences:

• At least 5 years of work experience in data engineering or similar
• Proficiency in Python with at least one data manipulation framework (e.g. Pandas, Dask, Pyspark) and SQL.
• Experience with REST APIs and building scalable API data platform (e.g. FastAPI)
• Experience with AWS, Snowflake, Kubernetes, and Airflow.
• Experience with Prometheus, Grafana, CloudWatch for monitoring and alerting
• Comfortable with Linux and command line operations.
• Experience hiring, mentoring and leading junior engineers
• Understanding of ETL processes and event streaming technologies (such as Kafka, Flink, etc.).
• Strong written and verbal communication skills, with the ability to effectively interact with both business and technical teams

Regular/Direct/Permanent employment with the client

Hybrid work Set up (3 days onsite, 2 days offsite)

Location - BGC, Taguig

Schedule - Rotational