- Việc làm
CVTạo CV online chuyên nghiệp, miễn phí
PortfolioTrình bày kỹ năng chuyên môn và dự án đã thực hiện một cách sinh động, trực quan.CVTạo CV online chuyên nghiệp, miễn phíTạo CVTạo CV online chuyên nghiệp, miễn phíMẫu CVTruy cập kho mẫu CV online ấn tượng, chuẩn quốc tế.CV mẫuTham khảo các CV mẫu đẹp đã được người dùng CakeResume ứng tuyển thành công.Cẩm nang nghề nghiệpTìm hiểu cách viết CV cho từng ngành nghề và vị trí.Trợ giúp viết CVTham khảo lời khuyên từ các chuyên gia tuyển dụng của CakeResume.- Kho tài nguyênCẩm nang ứng viênThế giới công sởVề đối tácCẩm nang doanh nghiệpVề CakeResumeBài viết nổi bật
- Tuyển dụng
- Tải app CakeResume
CakeResume Talent Search
Kế hoạch tuyển dụng đơn giản và hiệu quả nhất
Tìm kiếm 40k+ CV và chủ động liên hệ với ứng viên để đạt hiệu quả tuyển dụng cao hơn. Sự lựa chọn của hàng trăm công ty.
- Duyệt tất cả kết quả tìm kiếm
- Bắt đầu trò chuyện không giới hạn
- CV chỉ có thể truy cập bởi các công ty trả phí
- Xem địa chỉ email và số điện thoại của người dùng
Definition of Reputation Credits
linsam
data engineer、backend engineer
• 0972724528 • 台灣 • [email protected]
5~6 years experience with data engineer and soft engineer. (Distributed Queue System, Database, Web Crawling, RESTful API, ETL, Docker, CICD, GCP, K8S, Airflow ...etc.)
1~2 years experience with data science. (data analysis, machine learning and deep learning)
Work Experience
17 Live - Senior Data Engineer (IC5), May. 2021 - now
SinoPac Holdings - Software Engineer(Python), Nov. 2019 - May. 2021
• Develop python Api (shioaji) for stock/option/future place orde and account.
• Develop C# Api (shioaji) for stock/option/future place orde and account, and setup CI/CD with GitHub actions.
• Deploy test system for simulate trading by docker swarm.
• Collecting distributed system Log by elk, grafana and prometheus. 13GB log data/daily.
• Monitor distributed system and alert chatbot.
• Develop a transaction-by-trade and odd lot trading API.
Open Up Summit Speaker ( FinMind ) - 2019-12-01
Tripresso - Data Engineer, Oct. 2018 - Nov. 2019
• Analysis travel data and build a machine learning model. Estimating increase 3% orders (revenue).
• Maintain and develop an ETL distributed queuing system with 20 machines.
• Optimize the ETL system reduced more than 50% execution time.
• Develop new product crawler let product volume increase 1.5%.
• Making analysis BI charts provide for other departments.
Mandatory Military Service，Oct. 2017 - Oct. 2018
NDHU - RA, Mar. 2016 - Aug. 2017
Analysing G7 financial data. Model validation and parameter estimation by regression models ( SUR, MLE, Bootstrapping ). And comparing single equation estimators and confidence interval with system equation.
NDHU - TA, Sep. 2015 - Jul. 2017
Calculus, Linear Algebra, Statistics.
Projects
FinMind Open data Api
Open source financial data, more than 50 dataset, provide Api.
More than 2,000 people registered.
2,000 stars on github.
Automatic update daily by docker swarm, distributed queue system rabbitmq and celery ( 10 cloud machines ).
Total more than 1 billion data, 10 million streaming data per day.
Bosch Production Line Performance - Kaggle Post-competition analysis, top 6% rank.
Highly imbalance data, ratio is 1000 : 1, 10 GB dataset size. And the data is 50% missing value. More than 4000 variables, but I build models by only 50 features.
Rossmann Store Sales - Kaggle
Post-competition analysis, top 10% rank.
Time series problem. Building models predict sales after 48 days.
Grupo Bimbo Inventory Demand - Kaggle
Post-competition analysis, top 8% rank.
Time series problem, eighty millions data size. Building models predict inventory demand after 2 weeks.
Instacart Market Basket Analysis - Kaggle
Real competition, top 25% rank.
Predicting which products will an consumer purchase again.
Verification code to text
Create python package of Taiwan Train Verification Code to text.
The model is made by keras-CNN.
Skills
Distributed Queue System
1. Rabbitmq & Celery & Flower.
2. 8 nodes ( Cloud ) distributed queue system for web crawling.
3. Deploy by Docker and GKE.
4. Graceful Shutdown.
Database
1. MySQL ( RDBMS ).
2. Redis ( NoSQL ).
3. Dolphindb ( TSDB ).
GCP
CI/CD
1. Create automated tests and automated deploy for the FinMind team.
2. Using gitlab runner.
3. CD for auto publish python package.
4. CD for auto update and deploy new version service.
Log Collect & Monitor
1. Distributed system log collect by elk.
2. Prometheus and Grafana. Monitor user usage, request latency, request count
3. Monitor by telegram bot and slackbot.
4. Monitor vm and container by Netdata and cadvisor.
data pipeline
Machine Learning
xgboost, random forest, svm. statistics - ols, lasso.
Web Crawling
1. Python - request, BeautifulSoup, lxml, selenium.
2. Auto recognition captcha code by CNN model.
Data Mining
Python - numpy, pandas, sklearn.
R - parallel, dplyr, data.table, mice.
API
Stress Test
Education
National Dong Hwa University, Master of Science, Sep. 2017.
Major : Mathematics and Statistics.
Tamkang University. Bachelor of Science, Sep. 2015.
Languages
R, Python. Basic in English and proficient in Chinese.
linsam
data engineer、backend engineer
• 0972724528 • 台灣 • [email protected]
5~6 years experience with data engineer and soft engineer. (Distributed Queue System, Database, Web Crawling, RESTful API, ETL, Docker, CICD, GCP, K8S, Airflow ...etc.)
1~2 years experience with data science. (data analysis, machine learning and deep learning)
Work Experience
17 Live - Senior Data Engineer (IC5), May. 2021 - now
SinoPac Holdings - Software Engineer(Python), Nov. 2019 - May. 2021
• Develop python Api (shioaji) for stock/option/future place orde and account.
• Develop C# Api (shioaji) for stock/option/future place orde and account, and setup CI/CD with GitHub actions.
• Deploy test system for simulate trading by docker swarm.
• Collecting distributed system Log by elk, grafana and prometheus. 13GB log data/daily.
• Monitor distributed system and alert chatbot.
• Develop a transaction-by-trade and odd lot trading API.
Open Up Summit Speaker ( FinMind ) - 2019-12-01
Tripresso - Data Engineer, Oct. 2018 - Nov. 2019
• Analysis travel data and build a machine learning model. Estimating increase 3% orders (revenue).
• Maintain and develop an ETL distributed queuing system with 20 machines.
• Optimize the ETL system reduced more than 50% execution time.
• Develop new product crawler let product volume increase 1.5%.
• Making analysis BI charts provide for other departments.
Mandatory Military Service，Oct. 2017 - Oct. 2018
NDHU - RA, Mar. 2016 - Aug. 2017
Analysing G7 financial data. Model validation and parameter estimation by regression models ( SUR, MLE, Bootstrapping ). And comparing single equation estimators and confidence interval with system equation.
NDHU - TA, Sep. 2015 - Jul. 2017
Calculus, Linear Algebra, Statistics.
Projects
FinMind Open data Api
Open source financial data, more than 50 dataset, provide Api.
More than 2,000 people registered.
2,000 stars on github.
Automatic update daily by docker swarm, distributed queue system rabbitmq and celery ( 10 cloud machines ).
Total more than 1 billion data, 10 million streaming data per day.
Bosch Production Line Performance - Kaggle Post-competition analysis, top 6% rank.
Highly imbalance data, ratio is 1000 : 1, 10 GB dataset size. And the data is 50% missing value. More than 4000 variables, but I build models by only 50 features.
Rossmann Store Sales - Kaggle
Post-competition analysis, top 10% rank.
Time series problem. Building models predict sales after 48 days.
Grupo Bimbo Inventory Demand - Kaggle
Post-competition analysis, top 8% rank.
Time series problem, eighty millions data size. Building models predict inventory demand after 2 weeks.
Instacart Market Basket Analysis - Kaggle
Real competition, top 25% rank.
Predicting which products will an consumer purchase again.
Verification code to text
Create python package of Taiwan Train Verification Code to text.
The model is made by keras-CNN.
Skills
Distributed Queue System
1. Rabbitmq & Celery & Flower.
2. 8 nodes ( Cloud ) distributed queue system for web crawling.
3. Deploy by Docker and GKE.
4. Graceful Shutdown.
Database
1. MySQL ( RDBMS ).
2. Redis ( NoSQL ).
3. Dolphindb ( TSDB ).
GCP
CI/CD
1. Create automated tests and automated deploy for the FinMind team.
2. Using gitlab runner.
3. CD for auto publish python package.
4. CD for auto update and deploy new version service.
Log Collect & Monitor
1. Distributed system log collect by elk.
2. Prometheus and Grafana. Monitor user usage, request latency, request count
3. Monitor by telegram bot and slackbot.
4. Monitor vm and container by Netdata and cadvisor.
data pipeline
Machine Learning
xgboost, random forest, svm. statistics - ols, lasso.
Web Crawling
1. Python - request, BeautifulSoup, lxml, selenium.
2. Auto recognition captcha code by CNN model.
Data Mining
Python - numpy, pandas, sklearn.
R - parallel, dplyr, data.table, mice.
API
Stress Test
Education
National Dong Hwa University, Master of Science, Sep. 2017.
Major : Mathematics and Statistics.
Tamkang University. Bachelor of Science, Sep. 2015.
Languages
R, Python. Basic in English and proficient in Chinese.