Senior Data Engineer - CL10

Note: Salary is confidential and for sourcing purposes only. Final salary offer will depend on client and project assignment once selected.

Role Summary:

Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Position Overview:

If you are a problem-solver who thrives on optimizing complex SQL queries, orchestrating intricate workflows, and troubleshooting high-throughput data streams, we want you on our team.

Required Qualifications and Skills:

• Minimum 2 year(s) of relevant experience is required
• GCP Ecosystem: Strong, hands-on experience with Dataflow, Cloud Composer, and BigQuery. Working knowledge of Cloud Spanner is highly desirable.
• Data Streaming: Proven experience handling both batch and real-time or streaming data processing paradigms (e.g., Pub/Sub to Dataflow).
• Languages: Mastery of SQL (analytical and transactional) and proficiency in Python or Java (for Apache Beam or Airflow).
• Operations: Strong experience in monitoring, logging, and alerting (e.g., GCP Cloud Monitoring or Cloud Logging) and standard debugging practices.
• Data Engineering Fundamentals: Solid understanding of data modeling, ETL or ELT processes, and handling various file formats (Avro, Parquet, JSON, CSV).

Nice-to-Have Qualifications:

• Google Cloud Certified Professional Data Engineer.
• Experience with CI or CD pipelines for data infrastructure (Terraform, GitHub Actions).
• Familiarity with data governance and security best practices on GCP (IAM, KMS, DLP).