Manila - Data Engineer | Azure Databricks

apartmentYondu placeManila descriptionTemporary calendar_month8/29/25

A Data Engineer specializing in Azure Databricks is responsible for designing, developing, implementing, and maintaining scalable and robust data solutions within the Microsoft Azure ecosystem, with a strong focus on Databricks.

Key Responsibilities:

Data Pipeline Development:

Design, build, and maintain scalable data pipelines and ETL/ELT processes using Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and other Azure data services.

Big Data Processing:

Develop and optimize data transformation workflows using PySpark, Scala, and SQL on Databricks, handling large volumes of structured and unstructured data.

Data Lakehouse Implementation:

Implement and manage Delta Lake and Databricks Delta tables for building efficient data lakehouse architectures.

Collaboration:

Work closely with data scientists, analysts, and other engineers to understand data requirements and deliver solutions that support data-driven decision-making.

Performance Optimization:

Optimize Databricks clusters and data processing workflows for performance, cost efficiency, and resource utilization.

Data Quality and Governance:

Ensure data quality, integrity, and compliance with data privacy regulations throughout the data engineering process, including implementing data security and governance best practices (e.g., Unity Catalog, Azure Purview).

Monitoring and Maintenance:

Monitor data pipeline performance, troubleshoot issues, and perform necessary maintenance and updates.

Documentation:

Document data pipeline processes, technical specifications, and architectural designs.

Required Skills and Qualifications:

Technical Expertise:
Proficiency in Azure Databricks and Apache Spark.
Strong programming skills in Python (PySpark), Scala, and SQL.
Experience with Azure data services such as Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage.
Understanding of data warehousing, data lakes, and data lakehouse concepts.
Experience with big data technologies and ETL/ELT processes.
Cloud Platform Knowledge:

In-depth knowledge of Microsoft Azure cloud platform.

Problem-Solving:

Excellent analytical and problem-solving skills for debugging and optimizing data solutions.

Communication and Collaboration:

Strong communication and teamwork skills to collaborate effectively with cross-functional teams.

Relevant Certifications (Optional but beneficial):

Microsoft Azure Data Engineer Associate (DP-203), Databricks Certified Associate Developer for Apache Spark, Databricks Certified Professional Data Engineer.

business_centerHigh salary

Data Engineer (12-month period) | Work Onsite-Ortigas - Manila

apartmentSatellite OfficeplaceManila

DATA ENGINEER Work for our global clients and immerse in our rich and diverse company culture where you can thrive, grow and just be aweSOme! Apply now and discover the Satellite Office Candidate Experience – recognized as one of BEST among BPO...

starFeatured

Security Data Engineer (Automation)

placeMakati, 6 km from Manila

Engineer (Automation) should have: • A degree in Computer Science, Information Technology, or a related field. • Proficiency in automation tools and programming languages relevant to cyber security and data security. • Strong analytical skills to assess...

check_circleNew offer

Data Engineer

apartmentUnion Bank Of The PhilippinesplacePasig, 11 km from Manila

Job Description Job Summary: The Data Engineer will play a crucial role in designing, developing, and maintaining our data pipeline. This position involves working closely with data product managers and Data Architect to ensure the availability...

Best jobs you don't want to miss:

Engineer Jobs in Manila

Engineering Manager Jobs in Manila

Support Engineer Jobs in Manila 5 Urgent

Systems Engineer Jobs in Manila

Project Engineer Jobs in Manila 3 Urgent