Job Summary
Job description
Overview of job
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
- Clarify requirements with Developers and Business users to build a data mart that meets functional/non-functional business requirements.
- Design and maintain optimal data pipeline architecture.
- Support internal training and proper documentation ensuring the successful onboarding of new team members.
- Implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Develop efficient software code for multiple use cases leveraging Spark and Big Data Technologies for various use cases built on the platform.
Job Requirement
- At least 2+ years’ experience working as a Data Engineer role, ETL with large amounts of data. Bachelor’s degree in related technical discipline.
- Experience with data warehousing architecture, Data modeling and ETL data pipeline.
- Experience in monitoring data quality, code factor, Data quality control alert, ...
- Experience with using the following software/tool in the big data field.
- NoSQL and OLAP database: MongoDB, Elastic search, etc.
- Good at programming languages: Scala, Python, Java.
- Experience in the data testing process.
- Experience in performing root cause analysis, identify problems and propose recommendations for improvement.
- Strong organizational and multitasking skills with the ability to balance competing priorities.
- Fundamental knowledge of modern cloud computing platforms and concepts is a plus (AWS/GCP).
Languages
-
English
Speaking: Intermediate - Reading: Intermediate - Writing: Intermediate
Technical Skill
- Python
- ETL
- Data Warehouse
- Java
- MongoDB
- OLAP
- NoSQL
- Elasticsearch
- Scala
- AWS
- GCP
COMPETENCES
- Organizational Skills
- Multi-task Skills
BUSINESS PROFILE
STI applies technology to help businesses across Southeast Asia transform digitally.
We’ve just started on our journey of transforming the entire organization, from products to culture. We are growing rapidly with a mission to become a companion to both job seekers and employers on their journeys, and to equip them with best-in-class tools that help them along the way.