459 Data Engineers jobs in the Philippines
Big Data Engineer
Posted 1 day ago
Job Viewed
Job Description
POSITION PURPOSE: The big data team is responsible for developing, monitoring and maintaining the data warehouse and the integration of business development tools to enable a more strategic, tactical and operational business. Big data technologies include AWS hosted databases and components such as Postgres and Redshift DB's, AWS Data Pipelines, Lambda functions and Python code to deliver scalable solutions to the business.
KEY RESPONSIBILITIES:
- Designing and implementing the architecture of ETL using PySpark and SQL language in AWS Glue.
- Designing and developing transactional and analytical data structures.
- Aligning the Data technical capabilities to business objectives.
- Developing reporting solutions to support Business Intelligence, including resolving problems related to data analysis and reporting services.
- Establishing and maintaining policies, operational procedures, and associated documentation for user interaction with the database environment.
- Following Firstmac standards and best practice for the deployment of AWS components and code using source code controls such as BitBucket, and utilizing DevOps tools (e.g., Terraform), apps, and CLI as appropriate.
- Recommending improvements to existing approaches and practices within Data Governance forums and other appropriate meetings.
TECHNICAL SKILLS:
- Python 3+ including Virtual environments, PIP, Pypy, Package development, Boto3, sqlalchemy, Pytest
- ETL / ELT experience with SQL & Python within a big data environment.
- Experience with SQL and NoSQL databases
- Excellent coding skills, source control management (ie git) across programming languages with a strong focus on unit and integration testing
- SQL (ANSI, TSQL, PL/pgSQL)
- Experience in deploying AWS components remotely using AWS CLI Ability to perform database modelling and design, develop, debug, troubleshoot database objects, stored procedures and functions
- Knowledgeable on LINUX with the ability to program shell scripts
- Experience in developing and maintaining software solutions within the AWS ecosystem (S3, Redshift, DynamoDB).
JOB QUALIFICATIONS:
- With at least 3-5 years of work experience and familiarity with the entire software development life cycle and facilitating agile practices and methodology
- Graduate of Bachelor's Degree in Computer Science, Computer Engineering, Information Technology or related fields
KEY COMPETENCIES:
- Reporting and Analysis: Understanding of constructing, designing, and reporting using Power BI and a dimensional data warehouse.
- Communication: Proficient in communicating insights from Reports and Analysis to the business.
- Numeric and Data Analytics Skills: Prior experience implementing and utilizing analytics with BI tools such as Power BI, Python, and MongoDB data.
- Database Skills: Experience in working with databases and analysing insights preferably with Athena, Redshift, MongoDB.
IMPORTANT NOTE:
- 100mbps minimum internet speed.
- An ideal work space set-up for optimized work productivity is a given.
- Company asset (laptop) will provided upon hiring.
Interested parties may apply direct to Jobstreet. Interviews to be done online remotely by video call with Human Resources.
IT Business Analyst – Big Data
Posted 1 day ago
Job Viewed
Job Description
Overview
As a Business Analyst, you serve as a critical link between business needs
and the vast potential of data-driven insights. Your role encompasses a wide range
of responsibilities, from eliciting requirements to driving continuous improvement
initiatives. Collaborating closely with stakeholders and data experts, you leverage
cutting-edge technologies to unlock the value of data and drive strategic decision making.
Qualifications
- Bachelor's/College Degree in Computer Science, Information Management, Information Technology, Engineering (Computer/Telecommunication) or equivalent courses.
- Proficiency in managing relational database, such as Hive, Spark, MySQL, etc. is a plus.
- Proficiency in data modeling, database design, data mining and segmentation techniques is a plus.
- Strong problem-solving abilities with a disciplined and systematic approach.
- Proficient in SQL with excellent written and comprehension abilities in the language
- Excellent oral and written communications skills in English; Mandarin is a plus.
- Working knowledge of statistics and experience using statistical packages for analyzing datasets.
- Willing to work onsite in BGC, Taguig City
- Understanding of software design patterns and architectural principles
Responsibilities
- Conduct requirements elicitation, translating these into clear and organized business requirement, and prioritizing development and delivery in close
- coordination with key stakeholders and management.
- Perform various data analysis activities, including data mining, exploration and discovery, feature analysis, data modeling, portrait labeling, etc.
- Work closely with business owners to ensure any change in data structure and data elements are properly coordinated with the upstream team.
- Stakeholder Management: communicate and negotiate with key stakeholders and process owners to achieve a win-win solution given the constraints on costs, resources, skills, time, and other priorities.
- Project Management: plan, initiate, and manage constraints and deliverables to successfully complete and deliver project results.
- Quality Assurance: proactively manage incidents, problems, issues, and risks by implementing various techniques, methods, and best practices.
- Documentation and Knowledge Management: organize and prepare documentation of knowledge materials, including requirements specifications, solution design, flow charts, user manuals, etc., to ensure that all relevant information is recorded, stored, accessible and reusable.
- Improvement Initiatives: Research, assess, and employ best practices in data management, analysis, and controls, and continually enhance system functions and capabilities
- Work in a cross functional environment to source information, interact with diverse groups, and facilitate in delivering positive outcomes.
Senior Data Engineer – Data Pipelines
Posted 1 day ago
Job Viewed
Job Description
Job Description
As part of this maturnaty leave replacement you will be developing and operate supply chain solutions for specific data consuming applications or digital services. In addition, business consulting will be part of the job once the onboarding and training is finalized, and the setting will be in an agile teams.
Key Accountabilities / Responsibilities
- Design and development of data pipelines
- Support data scientists with data availability
- Shape and implement (data) best practices
- Snowflake, Azure, and lakehouse implementations in general
- Data Vault 2.0 and Vaultspeed
- DBT
Key Success Factors
- Onboarding of data sets according to plan
- Data Quality measures
- User Adoption KPIs
Required Minimum Qualifications
- Computer Science or other relevant field education
- Experience with Microsoft Azure or cloud platforms like Azure is a plus.
- Experience with Continuous Integration, Continuous Development and CI/CD pipelines is a plus.
- Knowledge of Python is a plus.
- Knowledge of SAP IBP is a plus
- Knowledge of data modeling and documentation is a plus.
Competencies
- Eager to learn more
- Fluent in English
- High drive
- Ability to work in complex work environment with a need to bridge solutions and approaches
Start date:
01/10/2025
End date:
31/12/2025
Location:
Manila, Philippines
Required skills
Data Vault
CI/CD piplines
Lakehouse
Vaultspeed
Continuous Integration
Data Pipelines
Azure
Data Best Practices
Snowflake
Continuous Development
Dbt
Preferred skills
SAP IBP
Data Modeling
Documentation
Python
Cloud Data Warehousing
Posted 1 day ago
Job Viewed
Job Description
Position Summary
The Data Warehousing DBA is responsible for ensuring the performance, availability, and security of cloud-based data warehouse systems. This includes proactive monitoring, performance tuning, capacity planning, disaster recovery, and automation of database operations. The ideal candidate will have hands-on experience with Google BigQuery, Azure Synapse, and related technologies, and will collaborate closely with cross-functional teams to support enterprise data initiatives.
Key Responsibilities
Database Operations & Maintenance
- Ensure database security, integrity, and high availability.
- Monitor and optimize database performance and capacity.
- Implement and maintain database maintenance plans and automation scripts.
- Perform SQL query tuning and optimization.
- Conduct root cause analysis and resolve database-related issues.
Cloud Data Warehousing Support
- Manage and support cloud-based data warehouse platforms (Google BigQuery, Azure Synapse).
- Collaborate with cloud vendors to plan and execute database migrations/upgrades.
- Stay current with platform features and best practices.
Collaboration & Documentation
- Work closely with Product Owners, Data Architects, DevOps Engineers, and Data Engineers.
- Maintain detailed documentation of database configurations, procedures, and troubleshooting steps.
- Participate in CI/CD pipeline development using Terraform and scripting tools.
Shift Coverage & Incident Response
- Provide overnight support for job monitoring, reruns, and system patching.
- Perform first-level troubleshooting and identify optimization opportunities during downtime.
- Participate in 24/7 on-call support rotation.
Technology Stack
- Cloud Platforms: Google BigQuery, Azure Synapse, Azure Databricks (limited), Google Spanner (future use)
- DevOps Tools: Azure DevOps, GitHub Actions, Terraform
- ETL Tools: Informatica Intelligent Cloud Services (IICS)
Required Qualifications
- 5+ years of experience in Data Warehousing, with at least 2 years on multiple platforms.
- 2+ years of hands-on experience with Google BigQuery and/or Azure Synapse.
- Strong understanding of Dimensional Modeling.
- Experience with CI/CD pipelines and Infrastructure as Code (IaC).
- Familiarity with networking principles and cloud architecture.
- Willingness to work overnight shifts and participate in on-call rotation.
Preferred Qualifications
- Certifications: Professional Cloud Database Engineer (Google), CDMP Associate
- Experience with data privacy, compliance, and risk management at an architectural level.
- Knowledge of Azure Databricks and Google Spanner.
- Experience with Terraform and scripting for infrastructure automation.
Work Arrangements:
Work Set-up: Hybrid/Wfh
Work Schedule: Midshift/Nighshift
Work Location: Open to Manila and Cebu based PH candidates
Data Engineer/ Senior Data Engineer
Posted 1 day ago
Job Viewed
Job Description
About Us
MoneyHero Group (Nasdaq: MNY) is a market leading financial products platform in Greater Southeast Asia, reaching 9.8m monthly unique users and working with more than 270 commercial partners across five markets including Singapore, Hong Kong S.A.R., Philippines, Taiwan, and Malaysia.
About The Job
The Senior Data Engineer is responsible for overseeing the design, development, implementation, and maintenance of all data-related systems, infrastructure, and processes within an organization. They will lead a team of data engineers and work closely with data scientists, business analysts, and other stakeholders to ensure that data is properly collected, processed, stored, and made available for analysis and decision-making purposes.
The Data Engineer Will
- Develop and implement technical data architecture and engineering strategies to support the organisation's data-driven initiatives, including data warehousing, ETL processes, and data governance.
- Build and maintain scalable and reliable data pipelines, ensuring data quality and consistency across all systems.
- Create and maintain data models that align with business requirements, ensuring data integrity and optimal performance
- Manage, guide and support junior data engineers in the development and implementation of data-related solutions
- Collaborate with data scientists, business analysts, and other stakeholders to identify data-related needs and requirements, and develop and implement solutions.
- Monitor and troubleshoot data-related issues, providing timely resolution and support to minimize downtime and disruption.
In This Role, We Are Looking For Someone With
- At least 4 years of hands-on experience in data engineering building scalable pipelines and infrastructure
- Create and maintain data models that align with business requirements, ensuring data integrity and optimal performance
- Strong technical skills in data warehousing, ETL processes, and database management systems, such as SQL, Python and dbt.
- Experience with cloud-based data technologies such as AWS, Azure, or Google Cloud ( BigQuery preferred)
- Knowledge of data security and privacy regulations, such as GDPR and HIPAA
- Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams and stakeholders
- Analytical and problem-solving skills, with the ability to identify and resolve data-related issues and implement effective solutions
- Bachelor's degree in computer science, engineering, or a related field
What can you expect from us?
Impact
: We are actively empowering and connecting people to a better financial future. Join us if you want to help us achieve our mission.
Work
: We have a team of over 350 talented individuals in 4 markets who are hyper passionate about building innovative financial solutions and making an impact on people's lives.
Culture
: We take our work seriously but don't hesitate to keep things light. We can only create magic when we have a little bit of fun.
Thrive
: We launched in 2014, and now help over 10 million monthly users make the best financial decisions. Accelerate your career and become a pioneer in your field with a leading fintech company that seeks to push the boundaries of your imagination and is committed to growing your career.
Reputation
: We are backed by world-class organizations and companies and have raised over US$110 million from investors including Experian, Pacific Century Group, IFC - a member of the World Bank Group
EEO Statement
MoneyHero Group is an equal opportunity employer. We value, support and respect all individuals and is committed to maintaining an inclusive and diverse working environment. Decisions in hiring are based on business needs, requirements of the job and individual qualifications and shall not be influenced by any consideration of race, ethnic or national origin, religion, sex (including gender identity and/or expression), age, sexual orientation, marital status, parental status, disability, genetic information, political affiliation or other applicable legally protected characteristics.
Data Engineer
Posted 1 day ago
Job Viewed
Job Description
REQUIRED SKILLS AND QUALIFICATIONS KEY RESPONSIBILITIES
• Lead the design, development, and maintenance of robust data pipelines and workflows.
• Write and optimize complex SQL queries, stored procedures, and views for performance and scalability.
• Oversee and manage the operational aspects of data stores.
• Drive data optimization, performance tuning, and integrity checks.
• Manage cloud-based SQL server (azure managed instance) environments.
• Lead the migration of data and systems from SQL server to snowflake.
• Work with datalake environments and support data ingestion and transformation processes.
• Collaborate with cross-functional teams including data analysts, developers, and business stakeholders.
• Provide technical leadership, code reviews, and mentorship to junior team members.
QUALIFICATIONS
• Strong SQL expertise including stored procedures, views, and performance tuning.
• Experience in azure cloud, particularly with SQL server managed instances.
• Hands-on experience with snowflake and cloud-based data migration.
• Familiarity with datalake architectures and concepts.
• Experience with ssis and/or crystal reports is a plus.
• Strong problem-solving skills and attention to detail.
• Excellent communication and leadership skills.
Data Engineer
Posted 1 day ago
Job Viewed
Job Description
Introduction
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
Your Role And Responsibilities
As a Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.
Your Primary Responsibilities Include
- Strategic Data Model Design and ETL Optimization: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.
- Robust Data Infrastructure Management: Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.
- Seamless Data Accessibility and Security Coordination: Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.
Required Technical And Professional Expertise
- Experience in ETL, Snowflake, and or DBT.
- Experience in SQL, Unix scripting and or Shell scripting,
- Experience on databases like DB2, Netezza.
- Experience in Scheduling tools like Control-M.
Preferred Technical And Professional Experience
- Technical Development experience
- Demonstrated client interaction and excellent communication skills; both (written and verbal)
- Amenable to work on a client dictated schedule (Day, Mid and Night) and Location
Be The First To Know
About the latest Data engineers Jobs in Philippines !
Data Engineer
Posted 1 day ago
Job Viewed
Job Description
The
Data Engineer
is responsible for the creation, maintenance, and continuous improvement of data pipelines. Part of his/her responsibilities are to implement best practices in data management practices (i.e., cleaning, validation, and transformation of data) make data into usable datasets that can easily be consumed by other teams. This role will also work closely with the software engineers, data analysts, data scientists and data governance to understand how the data behaves in its respective domain, to clarify business and technical requirements on different data use cases, and to design and create efficient and reliable data pipelines. Within Data Engineering, this person will learn and adopt best practices on data management, data architecture design, and DataOps principles. May it be in Central DE or Distributed DE, a Data engineer is crucial in creating value for downstream teams that use data.
About the Role
Key Responsibilities:
- Develop, maintain, and optimize data pipelines, data models, and data management solutions across data warehouses, data/delta lakes, or lakehouse environments.
- Collaborate with upstream teams (e.g., Mesh Teams) to integrate data sources and with downstream teams to ensure data usability and accessibility.
- Understand and adhere to existing technology standards and Data Engineering (DE) best practices.
Responsibilities
Central DE:
- Maintain and enhance the overall data architecture, ensuring scalability, high availability, and timely data ingestion.
- Build and optimize data pipelines for new data sources, applying DataOps principles to ensure seamless operations and minimal disruptions.
Distributed DE:
- Acquire and maintain deep domain knowledge of assigned data areas to inform data modeling and pipeline development.
- Design and develop data models for Zone 2 (silver layer) and Zone 3 (gold layer), ensuring business datasets are accurate, reliable, and ready for downstream consumption.
Qualifications
- Good working knowledge on Shell (e.g. bash, zsh) scripting
- Good working knowledge on data manipulation (SQL statements, JSON, NOSQL query, etc.)
- Good working knowledge on AWS services (EC2, S3, Glue Crawlers, Jobs, Batch, Athena, Lambda, etc.) or equivalent cloud offerings a big plus
- Good working knowledge on Apache Spark using SQL/Python
- Good understanding of the concepts of Datawarehouse, Data Lake/Delta Lake and/or Lakehouse
- Ability to work with other Leads to foster a culture of collaboration and teamwork
Required Skills
Central DE:
- Good knowledge on Linux/Unix Administration
- CI/CD experience using Terraform a big plus
Distributed DE:
- Good working knowledge on data modeling
Data Engineer
Posted 1 day ago
Job Viewed
Job Description
Why Nasdaq
When you work at Nasdaq, you're working for more open and transparent markets so that more people can access opportunities. Connections can be made, jobs can be created, and communities can thrive. We want all our employees to have access to opportunity, too. That means planning for career growth, ensuring you have the tools you need, and promoting an inclusive culture where we're all valued for our unique perspective.
Here, you will work for a global tech leader committed to breaking down barriers to inclusive prosperity. We see technology as a means to free people up to work together more productively and effectively by centralizing data, analytics, and market intelligence.
Here, we're committed to building a more diverse and inclusive workforce. Not only is it our responsibility to do better, but we also need representative voices to power the fresh thinking that is vital for our business and our clients.
What We Offer
This is a permanent full-time role based in Bonifacio Global City, Taguig following a hybrid work model setup (at least 2 in office days per week).
You can expect an autonomous but fast-paced work environment where you are recognized for your results and ability to drive things forward. Every day brings many opportunities to learn & grow and rewards with a global impact we create.
In return, you will receive HMO coverage for you and your dependents, employee stock purchase plan, equity grant, retirement plan, annual bonus, free counseling sessions, subscription to e-learning platforms, fitness, wellness and more.
What You Will Do
The Data Operations and Engineering (DOPE) division of Nasdaq Data Link is responsible for the datasets that our customers buy and consume every day. We are seeking a
Data Operations Analyst
to join our growing team.
As part of the Data Operations Team, you will contribute by monitoring and maintaining hundreds of datasets on Nasdaq Data Link. This includes monitoring various tools to ensure dataset timeliness and accuracy, communicating with stakeholders, prioritizing and resolving data issues, and handling various maintenance tasks related to data products. Specifically, you will:
- Continuously monitor a shared email inbox, various Slack channels and PagerDuty to respond to alerts related to data delays.
- Troubleshoot alerts and determine the appropriate course of action.
- Communicate with partners, Customer Success and other stakeholders to keep them aware of ongoing issues.
- Assist the various support teams to resolve outstanding queries from customers and partners.
- Develop your programming skills in Python, Spark and SQL.
- Learn to use new tools such as Databricks and Monte Carlo
What We Expect
- Have 1-3 years of professional experience in understanding data products and data management. Recent graduates are welcome to apply.
- Amenable to work on a rotational shift schedule and accommodate weekend work as the team operates 24/7 depending on business needs.
- Have a Bachelor of Computer Science/Engineering or equivalent degree or have equivalent qualifications/experience.
- Able to communicate professionally with internal and external stakeholders.
- Be eager to learn new technologies and best practices in data engineering by working with a world-class data team.
- Have a basic knowledge of Python/SQL/Git and be willing to further develop these skills
- Be eager to learn about parallel processing frameworks, orchestration/scheduling tools, and distributed data systems such as Databricks and Airflow.
- Be entrepreneurial and enthusiastic about working in a fast-paced environment.
What Would Be Helpful
- Familiarity with Databricks and Airflow
Does It Sound Like You?
Please follow through by clicking the "Apply" link and submitting your application. If your skills and experience are a match, we will be in touch soon. In the meantime, please visit our website and social media channels to learn more about our innovative business, inclusive culture and discover why Nasdaq Manila is Great Place To Work certified
Come as You Are
Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and/or expression, veteran status, genetic information, or any other status protected by applicable law.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request an accommodation.
Data Engineer
Posted 1 day ago
Job Viewed
Job Description
- Design and build robust, scalable, and efficient data pipelines using Spark (PySpark, Scala, SQL, etc.).
- Manage and optimize ETL/ELT processes, including data ingestion, transformation, and integration from multiple sources into data lakes and warehouses.
- Utilize Azure services such as Azure Data Factory, Azure Databricks, Azure Synapse, Azure Data Lake, and Azure SQL Database for data engineering tasks.
- Ensure data quality, reliability, security, and performance across all pipelines and systems.
- Collaborate with data analysts, BI developers, and stakeholders to understand data needs and deliver accurate solutions.
- Perform data profiling, validation, and cleansing to maintain integrity and consistency.
- Monitor, troubleshoot, and optimize existing pipelines and workflows.
- Document processes, data flows, and technical solutions.
Qualifications & Skills:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 3+ years of experience in data engineering or a similar role.
- Strong hands-on experience with Azure Data Factory, Databricks, Synapse, Data Lake, and SQL Database.
- Proficiency in ETL/ELT design and implementation.
- Expertise in Spark (PySpark, Scala, SQL) for large-scale data processing.
- Strong knowledge of SQL (querying, optimization, stored procedures).
- Familiarity with Python for scripting and automation.
- Understanding of data modeling, warehousing, and schema design.
- Knowledge of data governance, security, and compliance best practices.
- Strong analytical, problem-solving, and collaboration skills.
Additional Requirements:
- Open to Project based employment (12 months w/ possibility of absorption depends on your performance)