Tóm lược
Mô tả công việc
Tóm tắt công việc
We are seeking a highly skilled Data Engineer with deep expertise in Spark and AWS Glue to design, develop, and maintain scalable ETL pipelines. The ideal candidate will have experience working with large-scale data processing, cloud-native services, and modern data architecture.
Responsibilities:
- Collaborate with stakeholders to communicate complex technical concepts effectively.
- Provide technical guidance and mentorship to junior engineers and architects.
- Actively participate in the evaluation and selection data modeling and technologies.
- Design, develop, and optimize ETL/ELT pipelines using AWS Glue and Python
- Build and maintain data lakes and data warehouses on AWS (e.g., S3, Redshift).
- Collaborate with data analysts, scientists, and business stakeholders to understand data requirements.
- Implement data quality, governance, and security best practices.
- Monitor and troubleshoot Spark jobs and Glue workflows for performance and reliability.
- Develop and maintain documentation for data workflows and architecture.
- Ensure the quality delivery for batch ETL
At Hitachi Digital Services, we enjoy:
- Unique opportunity to work with multinational team of Hitachi in over 130 countries.
- Incomparable chance to participate in full Software Development Life Cycle (SDLCs) and comprehensive soft skills training.
- Competitive remuneration with attractive allowances & bonuses.
Hitachi Digital Services offers a competitive benefit packages. Come join us to enjoy:
- Opportunities for advanced career development overseas, including the US, UK,. Japan...
- Competitive & attractive compensation and benefits packages:
- Allowance for English, Japanese language certifications.
- Subsidy for transportation and meals.
- 13th salary & Bonus
- Additional Premium Health Insurance Package for employees.
- Annual checking of health and company trip for employees.
- Flexible working hours
- Being an integral part of a dynamic and fast-growing global enterprise.
- An open, professional, and nourishing environment with out-side of work activities, such as football, tennis, badminton, dancing, music, and charity.
Yêu cầu công việc
- Bachelor's degree in computer science or a related field.
- Having at least 2 years of experience as a Spark Senior (data modeling) and AWS Glue or in a similar role.
- Hands-on experience with AWS services, including EC2, VPC, S3, Lambda, ECS/EKS, RDS, IAM, and more.
- Proficiency in scripting languages such as Python or Bash.
- Experience with containerization technologies such as Docker.
- Excellent communication, presentation, and interpersonal skills in English.
- Strong analytical and problem-solving abilities.
Ngôn ngữ
-
English
Nói: Advanced - Đọc: Advanced - Viết: Advanced
Yêu cầu kỹ thuật
- Bash shell
- ETL
- Apache Spark
- Python
- AWS Lambda
- Docker
- Data Modeling
- Amazon S3
- Amazon RDS
- AWS
- Amazon EC2
- VPC
- Bash
- Amazon ECS
- Amazon EKS
- AWS Glue
- IAM
NĂNG LỰC
- Communication Skills
- Presentation Skills
- Interpersonal Skills
- Problem Solving Skills
- Analytic Skills
Thông tin doanh nghiệp
We’re Hitachi Digital Services, a global digital solutions business.
We harness digital innovation and a passion for technology to co-create meaningful solutions to complex challenges. Our people are trusted transformers, with deep engineering expertise, focused on a sustainable future for all. Together, we take our business and customers from what’s now to what’s next.
A Top 10 Coolest Industrial IoT Company, our data, cloud integration, modernization, and AI take theme park fans on magical rides. Conserve natural resources. Protect rainforests and save lives. We serve 85% of the Fortune 100, as well as nine out of ten of the top banks and telecoms, media, and entertainment companies. We guide businesses, industries, and society on a journey to identify and accelerate. Unlocking potential on a vast scale by transforming their enterprises with edge-to-core solutions, solutions that impact society, and the ways we all work and live.
Diversity, equity, and inclusion (DEI) are integral to our culture and identity. Diverse thinking, a commitment to allyship, and a culture of empowerment help us achieve powerful results. We want you to be you, with all the ideas, lived experience, and fresh perspective that brings. We support your uniqueness and give people from all backgrounds everything they need to succeed.
We help take care of your today and tomorrow with industry-leading benefits, as well as support, services, and resources that look after your holistic health and well-being.