Work Experience
Data Engineer • AD POST
April 2021 - Present
- Develop web crawlers for social media using Python, Scrapy, Playwright, etc.
- Build and maintain RESTful API server with FastAPI in Python.
- Use MongoDB/MySQL as data store and a part of data pipeline.
- Manage ETL system and web crawler with Airflow.
- Store and apply cached data with Redis.
- Pack and deploy modules and environment with Docker.
- Deploy service on GCP/AWS.
#Python #FastAPI #Airflow #Redis #Docker #MongoDB
Account executor • Micepad
September 2019 - March 2020
- Custom service
- Onsite assistance
- Building customized APP content
- Account management
Education
Ming Chuan University
Economics
2014 - 2018
技能
Programming Language & Related Tool
Python 
Pandas 
Scrapy 
PySpark
Backend
FastAPI 
Flask Django
Cloud Service
AWS GCP
Database
MySQL MongoDB Redis
Other
Docker Nginx 
PM2 
Airflow Linux
Programming
- Python
- REST API
- ETL
- SQL & NOSQL
Soft Skills
- elf-management
- Fast learner
Language
- Chinese
- English
