• Developed an API server for auto scheduling and extracting the product feed and sales feed from MSPs. • Designed and built the API server with Flask, Celery, DynamoDB, docker containers, along with AWS ECR, secret manager, Aurora. • Connected APIs for extracting product information and sales reports, e.g., Walmart, eBay, Shopee, Lazada, Shopify, etc. • Developed unit testing and integration testing. • Developed a scalable web crawling system and a data pipeline for collecting product information from e-Commerce websites. • Integrated Selenium, Splash, Python-requests into the crawling system. • Designed and built the web crawling system with Scrapy-Splash, Docker containers on AWS EC2, along with ECR, ALB, Route 53, Lambda, Serverless, Ansible, Traefik • Developed a downloader to automatically download files by using Play-wright, Selenium with proxy server.

- Python and Scrapy-redis framework for an automatically distributed crawler system - Flask and RESTful API in DMP backend service and goyomoney website backend service - Monitoring services by ElasticSearch, Kibana, Grafana and Prometheus - MySQL and Cassandra maintenance - Access user features in DMP platform by Spark

- Python and Scrapy-redis framework for an automatically distributed crawler system

- Develop a human resource system using PHP, MySQL, jQuery. Served 100+ people and 300,000+ members. - Develop websites using web framework like CI, OpenCart, WordPress, Joomla with bootstrap - Develop a email sending system using PHP - Build a video streaming server using IIS for 40+ nodes in Taiwan