4500 - 6000 SGD
Full-stack Developer | Software-system Administrator
Kuberneters | Docker | Functional programming | CI/CD | microsoft azure | devops | api | web scraping | linux command line | java | python
At DCI (Digital Commerce Intelligence Pte Ltd), we are committed to build South East Asia’s most intelligent digital commerce intelligence platform that enables brands & retailers to better understand and effectively drive their eCommerce Performance.
What you'll be doing:
- Develop infrastructure to ingest, transform, store and manage data feeds from
- web scrapers
- CSV /Excel files
- Containerize existing implementation using Kubernetes and Docker to make data ingestion scalable
- The ability to debug running data pipelines (e.g changes in APIs, file formats, scraped data) is critical
- Working with analytics teams to improve analytics dashboards and machine learning models trained from the data pipelines.
Your technical skill set shall include:
- Highly skilled in Python.
- Knowledge of Linux command line & networking, especially HTTP
- Knowledge of CI/CD and Devops practices is a plus
- Experience with Tor/ other web proxy methods would be a plus
- Experience working with containerization tools such as Docker & Kubernetes.
- Experience in Microsoft Azure Cloud Suite a plus.
What is critical :
- Experience in Web Scraping
- Understanding of modern full-stack web application architecture
- Strong technical communication skills, work ethic, open to learning new skills and capable of adapting to dynamic situations.