Data Engineer (Bulacan) - ref. v13603123
Motolite Santa Maria Full-time
JOB RESPONSIBILITIES
- Design, build, and maintain scalable data pipelines to collect, process, and store structured and unstructured data.
- Develop and manage ETL (Extract, Transform, and Load) processes to prepare data for analytics, and machine learning models.
- Perform web scraping and data mining to extract data from various online sources and APIs.
- Integrate data from multiple sources, including databases, cloud platforms, IoT systems, and external datasets.
- Ensure data quality, consistency, and security through governance frameworks and best practices.
- Optimize database performance and query efficiency to support real-time and batch processing workloads.
- Implement orchestration tools such as for managing workflows and machine learning pipelines.
- Monitor and troubleshoot data pipelines and workflows, ensuring minimal downtime and quick resolution of issues
- Collaborate with data scientists, analysts, and business teams to understand data needs and implement solutions.
- Stay updated on emerging technologies in data engineering, cloud computing, and big data analytics to recommend innovative solutions.
- Maintain detailed documentation of data architectures, pipelines, and system integrations for future reference and compliance.
- Graduate of bachelor's degree in computer science, Information Technology, Data Science, Engineering or other related field.
- Proficient in scalable data pipelines, and data transformation
- Strong programming skills in Python, SQL and Bash/Shell Scripting
- Experience with cloud data warehouse (Snowflake, BigQuery, and Redshift)
- Familiarity with AWS, Azure, or Google Cloud for data processing and analytics
- Expertise in web scraping, data mining, and preprocessing for analytics and machine learning
- Knowledgeable in big data tools and frameworks like Hadoop, Spark, and Kafka
- With experience with orchestration tools such as Dagster, MLFlow, and Databricks for managing workflows and machine learning pipelines is advantage
- Must be willing to work on-site in Sta. Maria, Bulacan
Vertere Global Solutions, Inc.Manila, 25 km from Santa Maria
Vertere Global Solutions Inc is hiring a Full time Data Engineer role in Salcedo Village, NCR. Apply now to be part of our team.
Job summary:
• Looking for candidates available to work:
• Monday: Morning
• Tuesday: Morning
• Wednesday: Morning...
Theoria MedicalPhilippines
talented individuals to join our amazing team and care for our population. We wish to extend a warm welcome to all candidates interested in making a difference in healthcare delivery by joining the Theoria team.
As the Senior Data Engineer, you...
IBMManila, 25 km from Santa Maria
skills and technical expertise to drive innovation and adoption of new technology.
Your role and responsibilities
As a Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities...