Overview:
This is a great opportunity for fresh grads to gain relevant technical experience in an in-demand field.
It will also give aspiring engineers the opportunity to work on the tools mentioned below, to interact with overseas teams, and to step into a leading role in charge of a team of 4-10 people within 3-6 months.
Position:
We are building a team of fresh developers to work on custom-made crawlers for growing a large and evolving database for our client.
Current work focuses on the US market but will expand to cover other territories such as China, Japan, the UK, Canada and Mexico.
Responsibilities include:
-Configure crawlers and feeds to support accurate data acquisition
- Monitoring and pro-actively troubleshoot daily operations
- Fine-tune crawlers and feeds schedules
- Monitor and upkeep the quality of end to end data pipeline
- Work with senior members of the team to track down issues and implement proper solutions
Qualifications:
- Minimum of 1 year of relevant experience
- Ability to learn quickly and develop expertise in configuring crawlers and feeds
- Knowledge of web crawling/scraping technologies is a plus
- Ability to interact well with both internal & external customers
- Knowledge of DOM (Document Object Model), JavaScript, MySQL and regular expression
- Knowledge of or experience with at least one programming language (Python, PHP, Java, Perl, etc) preferred Two-year technical college degree. BS Computer Science preferred.