Job Summary
Job description
Overview of job
The role
Intrepid is currently looking for a Data Engineer to be based in either Vietnam or Indonesia. As a Data Engineer, you are pivotal in building out Intrepid Insights, our key insights & analytics solution for brands. You are responsible for expanding, optimizing, and integrating our data from external sources into a common data warehouse model. You manage the data pipeline architecture, as well as optimize our data flow and collection for the product. You work closely with our strong engineering team, as well as our Insights analyst and product team on data initiatives and ensure an optimal data delivery architecture. You will be excited by the prospect of turning a vast amount of data into actionable insights and finding new ways to get data that can give our clients an edge over their competition.
Your responsibilities include:
- Design, develop and maintain crawler system, data pipelines, data governance compliance, procedures, and tooling to scrape public ecommerce websites.
- Own the creation and maintenance processes of these tools, services, and workflows to improve crawl/scrape analysis, reports and data management.
- Test the data from API and the scraping to ensure accuracy and quality
- Work closely with the team leader and follow the guideline to accomplish assigned tasks
Job Requirement
What we are looking for:
- Experience running large scale web scrapes
- Familiarity with techniques and tools for crawling, extracting and processing data
- 2-4 years of hands-on experience of writing code, scripts and APIs (Python/PHP)
- Familiarity with Linux/UNIX, HTTP, HTML, JavaScript and Networking
- Experience with serverless compute components, App Engine, Spanner, BigQuery, Cloud Functions, Cloud Storage
- Experience with system monitoring/administration tools
- Proficient understanding of code versioning tools, such as Git, SVN
- Experience following Agile methodology
- Ability to dive into technical details and design analytics solutions to meet business needs
- Strong understanding of data flow and system integrations
- Good verbal, written communication skills in English
- Experience or understanding eCommerce (metrics) is a plus
Languages
-
English
Speaking: Intermediate - Reading: Intermediate - Writing: Intermediate
Technical Skill
- Python
- PHP
- API
- JavaScript
- HTML
- Linux
- Git
- Unix
- HTTP
- SVN
COMPETENCES
- Agile
- Communication Skills
BUSINESS PROFILE
Intrepid enables their partners to seize the full potential of ecommerce.
Intrepid is a fast-growing and industry-leading ecommerce enabler, making sellers and brands successful in Ecommerce on all marketplace platforms across South East Asia through a combination of software solutions and value-added services across store management, online marketing, customer service (e.g. chat), data & intelligence, and fulfilment & logistics. The company operates in Indonesia, Philippines, Singapore, Vietnam, Thailand and soon Malaysia. Intrepid was started by ex-Lazada founders and is run by a young, enthusiastic and energetic team, looking to help brands and sellers seize the full potential of the ecommerce opportunity in South East Asia.