Home Credit Vietnam

Tóm tắt công việc

• Implement the DataOps philosophy in everything you do
• Maintain best practices to facilitate optimized software development and continuous improvement/continuous delivery (CI/CD)Work on full scale Data Lake implementations based on Cloudera Platform (Spark, Hadoop, Hive, Impala, YARN).
• Assist with data architecture, automation and planning
• Develop end to end data pipeline to ELT data from multiple source system (Kafka, Database, API, File System, CDC) to Data Lake that follow best practices
• Improve development and deployment flow, including building, testing, deploying, etc.
• Deliver medium to large data features independently
• Design and implement Kimball data model for serving layer for BU
• Guide junior member on best practice

• 2+ years hands-on experience on Big Data Engineering.
• Professional experience using Python, Scala for data processing
• Demonstrably deep understanding of SQL and analytical data warehouses
• Hands-on experience implementing ETL (or ELT) and data pipeline practice best practices at scale
• Hands-on experience with data tools (Airflow, dbt, Spark, Kafka, Hadoop, Hive)
• Strong data modeling skills and familiarity with the Kimball methodology
• Expertise in designing and developing distributed data pipelines using big data technologies on large scale data sets demonstrated with years of proven experience.
• Hands-on experience with CDC solution (preferred Oracle Golden Gate) for data ingestion/integration
• Show efficiency in handling data - tracking data lineage, ensuring data quality, and improving discoverability of data.