CakeResume
CakeResume Logo
Log In
Sign Up
Build your Network
My Network
Access your personal network connections and manage your contacts.
CakeResume Meet
Expand your professional network by meeting and connecting with other users.
Community
Engage with other users through discussions, forums, and networking events.
Log In
Sign Up

CakeResume Talent Search

Advanced filters
On
Ready to interview
Open to opportunities
Not open to opportunities
Taiwan
Taipei City, Taiwan
台灣
Taipei, Taiwan
台北市, 台灣
New Taipei City, Taiwan
India
Taichung City, Taiwan
भारत
United States
新北市, 台灣
Iran
Kaohsiung City, Taiwan
Taoyuan City, Taiwan
Hsinchu City, Taiwan
Japan
新竹市, 台灣
桃園市, 台灣
California, United States
Canada
IT
Management / Business
Design
Game Production
Bio, Medical
Construction
Engineering
Finance
Marketing / Advertising
Media / Communication
Sales
Tech
Industry
Banking / Insurance / Finance
Advertising / Marketing / Agency
Consultant / Audit
Culture / Media / Entertainment
Education / Training / Recruitment
Hotel / Tourism / Leisure
Distribution
Health / Social / Environment
Medical
Mobility / Transport
Public administration
Real estate
Less than 1 year
1-2 years
2-4 years
4-6 years
6-10 years
10-15 years
More than 15 years
AI Smart Matching
On
National Taiwan University
國立台灣大學
國立臺灣大學
National Taiwan University of Science and Technology
國立台灣科技大學
國立臺灣科技大學
Fu Jen Catholic University
輔仁大學
National Chung Cheng University
國立中正大學
Chung Yuan Christian University
National Central University
National Cheng Kung University
National Taipei University of Technology
National Yang Ming Chiao Tung University
National Yunlin University of Science and Technology
中原大學
國立中央大學
國立台北科技大學
國立成功大學
國立臺北科技大學
國立陽明交通大學
國立雲林科技大學
National Chin-Yi University of Technology
Tamkang University
Yuan Ze University
元智大學
國立勤益科技大學
淡江大學
Chaoyang University of Technology
Taiwan
台灣
Taipei City, Taiwan
台北市, 台灣
New Taipei City, Taiwan
新北市, 台灣
United States
India
Taichung City, Taiwan
台中市, 台灣
Japan
Kaohsiung City, Taiwan
Singapore
भारत
日本
Taoyuan City, Taiwan
桃園市, 台灣
Canada
Great Britain
Hsinchu City, Taiwan
Full-time
Part-time
Intern
Python
Django
docker
JavaScript
AWS
Git
MySQL
Linux
MongoDB
PostgreSQL
No
Yes
1-5 people
5-10 people
10-15 people
15+ people
Within one month
Within two months
Within three months
Within six months
Within one year
More than one year
軟體工程師
Software Engineer
後端工程師
Software Engineer / Backend Engineer
Senior Software Engineer
Front-End / Back-End / Full Stack Web Developer
Python Developer
backend engineer
前端工程師、後端工程師、全端工程師
資深軟體工程師
Associate’s Degree
Bachelor of Arts (BA)
Bachelor of Engineering (BEng)
Bachelor of Science (BS)
Bachelor’s Degree
Engineer’s Degree
Master of Business Administration (MBA)
Master of Science (MS)
Master’s Degree
Other
High school
Associate
Bachelor
Master
Doctoral
2022
2018
2017
2016
2015
2014
2013
2012
2008
2006
Current company
Off
Select all
趨勢科技
TSMC 台積電
Upwork
塔圖科技股份有限公司
TrendMicro
三博鹿網路科技股份有限公司
國立雲林科技大學
天堂遊戲有限公司
恩克斯網路科技股份有限公司
找樂子創意流通股份有限公司
Interested in working remotely
Not interested in working remotely
Remote Only
Full-time freelancer
Part-time freelancer
Non-freelancer
Chinese - Native or Bilingual
English - Intermediate
English - Fluent
English - Professional
English - Beginner
English - Native or Bilingual
Japanese - Beginner
Chinese - Fluent
Chinese - Professional
Hindi - Native or Bilingual
English
Chinese
German
Korean
Spanish
4-6 years
6-10 years
10-15 years
More than 15 years
  • Exclude read results
  • Show all experiences
Avatar of 朱殷頤.
Avatar of 朱殷頤.
朱殷頤
Past
MIS @上台科技股份有限公司
・
2017 ~ 2023
前端工程師、後端工程師、全端工程師
Within one month
技術學院資訊管理系二技 個人特點 專案協作與規劃 專案獨立實行能力 BUG應變 排除 技術自學及第三方API整合 後端整合 DJANGO MYSQL REDIS Django框架 透過MTV結構 經路由存取資料庫數據返回給前端 MySQL資料庫 資料持久化負責保存資料 Redis資料庫 主要協助作
MYSQL
Django(Python)
RESTful API
Unemployed
・
Ready to interview
Full-time / Interested in working remotely
4-6 years
中華科技大學
・
資管理系
Avatar of Brad Lo.
Avatar of Brad Lo.
Brad Lo
產品專案經理/全端工程師 @FITI Foxsemicon (Foxconn Technology Group)
・
2018 ~ Present
Maker
Within one month
. Led UI/UX acceptance and facilitated team discussions. Arbitrated issue responsibility and spearheaded cross-functional bug troubleshooting. Reviewed firmware solution provider qualifications and coordinated technical details. Work Experience AprilPresent Full Stack Engineer FIT (Foxconn Technology Group) Led the "Acoustic Product Development Line" project: Developed testing software for production line stations (Python). Managed yield analysis platform for the production line (Django + Vue.js). Designed prototype for automated fixture platform (ESP32). Urgent support for the "Prominent Product OEM Line," leading local team in Python development of AOI inspection ins...
Python
C#
JavaScript
Employed
・
Ready to interview
Full-time / Interested in working remotely
10-15 years
國立台灣海洋大學 (NTOU)
・
系統工程暨造船學系
Avatar of the user.
Avatar of the user.
Available for paid companies
技術總監 L2 @和雲行動服務股份有限公司 (和泰汽車集團）
・
2022 ~ Present
Project Lead / Tech Lead / Team Lead / Senior Engineer
Within one month
django
Python
django rest framework
Reputation Credits1
Employed
・
Ready to interview
Full-time / Interested in working remotely
10-15 years
Asia University / 亞洲大學
・
生物資訊
Avatar of the user.
Avatar of the user.
Available for paid companies
Past
Full Stack Developer @INOVATEUS SOLAR
・
2021 ~ 2022
Front-End / Back-End / Full Stack Web Developer
Within three months
React.js
React Native
React Hooks
Unemployed
・
Ready to interview
Full-time / Remote Only
6-10 years
Universiti Teknologi Malaysia (UTM)
・
Computer Science
Avatar of 張逸.
Avatar of 張逸.
張逸
Backend Engineer @酷訊搜索股份有限公司
・
2021 ~ Present
軟體工程師
Within one month
薦系統需要的節目標籤資料 (Django, Bootstrap, jQuery) 與臺科大 AI 中心合作撰寫推薦系統核心 (Keras, Pandas, MariaDB, Crontab) 串接遠傳智慧音箱使其能夠控制機上盒 (OAuth2, Docker, NodeJS) 機上盒網站開發~與前端工程師遠端合作更新會員中心 (PHP Phalcon, Memcache, Jenkins) Ski lls Programming Python Web Back-end Flask Django Data Science Pandas Selenium DevOps K8S Cloud Run
Python
git
Docker
Employed
・
Open to opportunities
Full-time / Interested in working remotely
4-6 years
政治大學
・
資訊科學
Avatar of Yen-Shou Hsieh.
Avatar of Yen-Shou Hsieh.
Yen-Shou Hsieh
技術專理 @鴻海
・
2018 ~ Present
軟體工程師、系統架構師、PM、技術主管、AI工程師
Within one month
發時程規劃，據時程規劃來將模組化的需求分派開發給團隊成員，協助團隊完成開發任務。 專案： 智慧城市-交通辨識系統 POC (Django, Vue.j, Docker, OpenCV, Elasticsearch) ADAS 數據集視覺化 (Javascript, Python) SVM 系統 POC (C/C++, Android, OpenCV, FastCV) 大樓用電量資料處理 (Python, MySQL, Elasticsearch) 分散式模型部署系統 POC
Java
python
R
Employed
・
Open to opportunities
Full-time / Interested in working remotely
4-6 years
國立雲林科技大學
・
資訊管理
Avatar of the user.
Avatar of the user.
Available for paid companies
Software Engineer @Hewlett Packard Enterprise (HPE)
・
2021 ~ Present
Senior Software Engineer
Within two months
C++
C#
Unreal Engine 4
Employed
・
Open to opportunities
Full-time / Interested in working remotely
6-10 years
National Chung Cheng University
・
Master of Computer Science
Avatar of linsam.
Offline
Avatar of linsam.
Offline
linsam
Senior Data Engineer (IC5) @17LIVE
・
2021 ~ Present
Data Solution Architect, Sr. Data Engineer, Data Engineer Manager
Within one month
junior data engineers to be more effective individual contributors. • Apply the data team's models to the company's APP. ( automatically send push notifications and in-app messages ) • Automatically update recommend streamer list via data team's models to the company's APP. SinoPac Holdings - Software Engineer(Python), NovMay• Develop python Api (shioaji) for stock/option/future place orde and account. • Develop C# Api (shioaji) for stock/option/future place orde and account, and setup CI/CD with GitHub actions. • Deploy test system for simulate trading by docker swarm
Python
MySQL
Linode
Employed
・
Open to opportunities
Full-time / Interested in working remotely
4-6 years
NDHU
・
統計
64,000+
Avatar of 簡至善.
Avatar of 簡至善.
簡至善
Corp. IT Data Engneer @Morrison Express Corp.
・
2022 ~ Present
Python Developer
Within three months
Kuchi Technology Developed and maintained a robust 24/7 Taiwan futures trading system with no downtime over 12 hours for 12 consecutive months. Developed over 10 web scraping services using Python including Requests, BeautifulSoup and Selenium to extract data. Expert in data cleaning and data mining using Python libraries like Pandas, NumPy and Matplotlib Developed dozens of trading strategies and a backtesting system to generate analytics reports. Full-stack development of strategy websites using HTML, CSS (Sass), JavaScript (jQuery), Python (Django, Flask). 四月十月 2016 Intern Kuchi Technology Assisted in developing a social
Python
Django(Python)
Flask(Python)
Employed
・
Open to opportunities
Full-time / Interested in working remotely
6-10 years
國立台灣大學 (National Taiwan University, NTU)
・
Psychology
Avatar of Hans Yen.
Avatar of Hans Yen.
Hans Yen
Technology Leader @AIBDT
・
2023 ~ Present
Software Engineer / Backend Engineer
Within one month
.Change system structure to scale-out (ex: celery, airflow) 3.Add new index in mogodb table, seperate data to raw data and query data to promotion query efficacy etc. 4.Use airflow make a job regular remove over 1 year data in mongodb 5.Use django admin schedule run AI analyze 6.Add multithreads in product django 7.Use Ansible to deploey 8.Maintenance costumer, developer, demo environment Company: https://www.aibdt.com.tw/ Google Project Hatch no.2 is me( count from right ) https
Intelligent
Cooperation
Curious
Employed
・
Open to opportunities
Full-time / Interested in working remotely
4-6 years
National Taiwan University
・
Agricultural Chemistry

The Most Lightweight and Effective Recruiting Plan

Search resumes and take the initiative to contact job applicants for higher recruiting efficiency. The Choice of Hundreds of Companies.

  • Browse all search results
  • Unlimited access to start new conversations
  • Resumes accessible for only paid companies
  • View users’ email address & phone numbers
Upgrade Now
7-day money-back guarantee, cancel anytime
123456789
Search Tips
1
Search a precise keyword combination
senior backend php
If the number of the search result is not enough, you can remove the less important keywords
2
Use quotes to search for an exact phrase
"business development"
3
Use the minus sign to eliminate results containing certain words
UI designer -UX
Only public resumes are available with the free plan.
Upgrade to an advanced plan to view all search results including tens of thousands of resumes exclusive on CakeResume.
Upgrade Now

Definition of Reputation Credits

Technical Skills
Specialized knowledge and expertise within the profession (e.g. familiar with SEO and use of related tools).
Problem-Solving
Ability to identify, analyze, and prepare solutions to problems.
Adaptability
Ability to navigate unexpected situations; and keep up with shifting priorities, projects, clients, and technology.
Communication
Ability to convey information effectively and is willing to give and receive feedback.
Time Management
Ability to prioritize tasks based on importance; and have them completed within the assigned timeline.
Teamwork
Ability to work cooperatively, communicate effectively, and anticipate each other's demands, resulting in coordinated collective action.
Leadership
Ability to coach, guide, and inspire a team to achieve a shared goal or outcome effectively.
Within two months
Avatar of linsam.
linsam
Sr. Data Engineer
17LIVE
・
2021 ~ Present
Taipei, 台灣
Professional Background
Current status
Employed
Job Search Progress
Open to opportunities
Professions
Data Engineer, Python Developer, System Architecture
Fields of Employment
Information Services
Work experience
4-6 years
Management
None
Skills
Python
MySQL
Linode
API Development
Linux
RabbitMQ
Celery
Nginx
Flask(Python)
Django(Python)
Git
docker swarm
Docker
docker-compose
Data Mining
Machine Learning
Traefik
Redis
ELK(ElasticSearch)
ELK
Prometheus
Grafana
Airflow
dolphindb
SQL
FastAPI
GKE
K8S
Real-Time Systems
GCP
Languages
English
・
Intermediate
Job search preferences
Positions
Data Solution Architect, Sr. Data Engineer, Data Engineer Manager
Job types
Full-time
Locations
Taipei, 台灣, Taiwan
Remote
Interested in working remotely
Freelance
Yes, I freelance in my spare time
Educations
School
NDHU
Major
統計
Print
Profile 02 00@2x 71843ef6a0df47d6255a9c0436c409dcd5cd81f6514c51a6b2a93339d82bbff6

linsam

data engineer、backend engineer

 • 0972724528 •  台灣  •  [email protected]

5~6 years experience with data engineer and soft engineer. (Distributed Queue System, Database, Web Crawling, RESTful API, ETL, Docker, CICD, GCP, K8S, Airflow ...etc.)

1~2 years experience with data science. (data analysis, machine learning and deep learning)

Work Experience


17 Live -  Senior Data Engineer (IC5), May. 2021 - now

• Refactor ETL, create a airflow project by Cloud Composer to transfer ETL tools from digdag to airflow and transfer ETL develop method from shell script to python. 
• Maintenance BigQuery more than 100 tables. 
• Create pipelines from mysql and mongo to bigquery. 
• Create a good development culture, including the introduction of CICD, dev-stage-uat-master, release news, unit tests and test coverage. 
• Using Airflow unified scheduler job, like cloud function scheduler, BQ scheduler, crontab, and ML model by R or Python ...etc.
• Reduce Data Team 25% cost.
• Create Data Team's first real-time ETL system via GKE, Pub/Sub and Memorystore for sending push notifications to users.
• Create Data Team's first API via GKE for ML model, include achieve graceful shutdown, and run stress test via ApacheBench, and setup auto-scaling by hpa. 95% latency is under 200ms and RPS is over 200.
• Create a Tagging System for tracking groups of users. 
• Create a BigQuery Resource Monitor to monitor users BQ slot and query count usage. 
• Create document culture by confluence.
• The finalists of Break the Norm awards on 2021-Q3 and 2021-Q4. 
• Assist in interview more than 10 new data engineer. 
• Mentor junior data engineers to be more effective individual contributors.
• Apply the data team's models to the company's APP. (automatically send push notifications and in-app messages) 
• Automatically update recommend streamer list via data team's models to the company's APP.

SinoPac Holdings -  Software Engineer(Python), Nov. 2019 - May. 2021

• Develop python Api (shioaji) for stock/option/future place orde and account. 

• Develop C# Api (shioaji) for stock/option/future place orde and account, and setup CI/CD with GitHub actions.

• Deploy test system for simulate trading by docker swarm.

• Collecting distributed system Log by elk, grafana and prometheus. 13GB log data/daily.

• Monitor distributed system and alert chatbot.

• Develop a transaction-by-trade and odd lot trading API.

Open Up Summit Speaker ( FinMind ) - 2019-12-01

Tripresso - Data Engineer, Oct. 2018 - Nov. 2019 

• Analysis travel data and build a machine learning model. Estimating increase 3% orders (revenue). 

• Maintain and develop an ETL distributed queuing system with 20 machines. 

• Optimize the ETL system reduced more than 50% execution time. 

• Develop new product crawler let product volume increase 1.5%. 

• Making analysis BI charts provide for other departments.

Mandatory Military Service，Oct. 2017 - Oct. 2018

NDHU - RA, Mar. 2016 - Aug. 2017

Analysing G7 financial data. Model validation and parameter estimation by regression models ( SUR, MLE, Bootstrapping ). And comparing single equation estimators and confidence interval with system equation.

NDHU - TA, Sep. 2015 - Jul. 2017

Calculus, Linear Algebra, Statistics.

Projects

FinMind Open data Api


Open source financial data, more than 50 dataset, provide Api. 

More than 2,000 people registered.

2,000 stars on github.

Automatic update daily by docker swarm, distributed queue system rabbitmq and celery ( 10 cloud machines ). 

Total more than 1 billion data, 10 million streaming data per day.

Architecture diagram.


Bosch Production Line Performance - Kaggle Post-competition analysis, top 6% rank.

Highly imbalance data, ratio is 1000 : 1, 10 GB dataset size. And the data is 50% missing value. More than 4000 variables, but I build models by only 50 features.

Rossmann Store Sales - Kaggle 

Post-competition analysis, top 10% rank.

Time series problem. Building models predict sales after 48 days.

Grupo Bimbo Inventory Demand - Kaggle

Post-competition analysis, top 8% rank. 

Time series problem, eighty millions data size. Building models predict inventory demand after 2 weeks.

Instacart Market Basket Analysis - Kaggle

Real competition, top 25% rank. 

Predicting which products will an consumer purchase again.


 Verification code to text

Create python package of Taiwan Train Verification Code to text.

The model is made by keras-CNN.

Skills

Distributed Queue System

1. Rabbitmq & Celery & Flower. 

2. 8 nodes ( Cloud ) distributed queue system for web crawling. 

3. Deploy by Docker and GKE.

4. Graceful Shutdown.

Database

1. MySQL ( RDBMS ). 

2. Redis ( NoSQL ). 

3. Dolphindb ( TSDB ).

GCP

1. Pub/Sub.
2. GKE ( K8S ).
3. GCE.
4. BQ.
5. Composer.
6. MemoryStore.

CI/CD

1. Create automated tests and automated deploy for the FinMind team. 

2. Using gitlab runner. 

3. CD for auto publish python package. 

4. CD for auto update and deploy new version service.

Log Collect & Monitor

1. Distributed system log collect by elk.  

2. Prometheus and Grafana. Monitor user usage, request latency, request count 

3. Monitor by telegram bot and slackbot.

4. Monitor vm and container by Netdata and cadvisor.


data pipeline

1. Design data pipeline for crawler, backend and analysis by airflow.
2. Design more 200 ETL by airflow.
3. Build airflow by composer
4. Build a real-time pipeline for sending push notifications to users

Machine Learning

xgboost, random forest, svm. statistics - ols, lasso.

Web Crawling

1. Python - request, BeautifulSoup, lxml, selenium. 

2. Auto recognition captcha code by CNN model.

Data Mining

Python - numpy, pandas, sklearn. 

R - parallel, dplyr, data.table, mice.

WEB

1. https://finmindtrade.com/ 

2. nginx

3. frontend - vue 

4. backend - python 

5. traefik.

API

1. FastAPI.
2. Websocket.
3. Loading Balance.
4. Async.
5. Graceful Shutdown.

Stress Test 

1. ApacheBench.
2. Upper bound of FinMind api is 8000/minute request.


Education

National Dong Hwa University, Master of Science,  Sep. 2017.

Major : Mathematics and Statistics.

Tamkang University. Bachelor of Science, Sep. 2015.

Major : Mathematics

Languages

R, Python. Basic in English and proficient in Chinese.

Resume
Profile
Print
Profile 02 00@2x 71843ef6a0df47d6255a9c0436c409dcd5cd81f6514c51a6b2a93339d82bbff6

linsam

data engineer、backend engineer

 • 0972724528 •  台灣  •  [email protected]

5~6 years experience with data engineer and soft engineer. (Distributed Queue System, Database, Web Crawling, RESTful API, ETL, Docker, CICD, GCP, K8S, Airflow ...etc.)

1~2 years experience with data science. (data analysis, machine learning and deep learning)

Work Experience


17 Live -  Senior Data Engineer (IC5), May. 2021 - now

• Refactor ETL, create a airflow project by Cloud Composer to transfer ETL tools from digdag to airflow and transfer ETL develop method from shell script to python. 
• Maintenance BigQuery more than 100 tables. 
• Create pipelines from mysql and mongo to bigquery. 
• Create a good development culture, including the introduction of CICD, dev-stage-uat-master, release news, unit tests and test coverage. 
• Using Airflow unified scheduler job, like cloud function scheduler, BQ scheduler, crontab, and ML model by R or Python ...etc.
• Reduce Data Team 25% cost.
• Create Data Team's first real-time ETL system via GKE, Pub/Sub and Memorystore for sending push notifications to users.
• Create Data Team's first API via GKE for ML model, include achieve graceful shutdown, and run stress test via ApacheBench, and setup auto-scaling by hpa. 95% latency is under 200ms and RPS is over 200.
• Create a Tagging System for tracking groups of users. 
• Create a BigQuery Resource Monitor to monitor users BQ slot and query count usage. 
• Create document culture by confluence.
• The finalists of Break the Norm awards on 2021-Q3 and 2021-Q4. 
• Assist in interview more than 10 new data engineer. 
• Mentor junior data engineers to be more effective individual contributors.
• Apply the data team's models to the company's APP. (automatically send push notifications and in-app messages) 
• Automatically update recommend streamer list via data team's models to the company's APP.

SinoPac Holdings -  Software Engineer(Python), Nov. 2019 - May. 2021

• Develop python Api (shioaji) for stock/option/future place orde and account. 

• Develop C# Api (shioaji) for stock/option/future place orde and account, and setup CI/CD with GitHub actions.

• Deploy test system for simulate trading by docker swarm.

• Collecting distributed system Log by elk, grafana and prometheus. 13GB log data/daily.

• Monitor distributed system and alert chatbot.

• Develop a transaction-by-trade and odd lot trading API.

Open Up Summit Speaker ( FinMind ) - 2019-12-01

Tripresso - Data Engineer, Oct. 2018 - Nov. 2019 

• Analysis travel data and build a machine learning model. Estimating increase 3% orders (revenue). 

• Maintain and develop an ETL distributed queuing system with 20 machines. 

• Optimize the ETL system reduced more than 50% execution time. 

• Develop new product crawler let product volume increase 1.5%. 

• Making analysis BI charts provide for other departments.

Mandatory Military Service，Oct. 2017 - Oct. 2018

NDHU - RA, Mar. 2016 - Aug. 2017

Analysing G7 financial data. Model validation and parameter estimation by regression models ( SUR, MLE, Bootstrapping ). And comparing single equation estimators and confidence interval with system equation.

NDHU - TA, Sep. 2015 - Jul. 2017

Calculus, Linear Algebra, Statistics.

Projects

FinMind Open data Api


Open source financial data, more than 50 dataset, provide Api. 

More than 2,000 people registered.

2,000 stars on github.

Automatic update daily by docker swarm, distributed queue system rabbitmq and celery ( 10 cloud machines ). 

Total more than 1 billion data, 10 million streaming data per day.

Architecture diagram.


Bosch Production Line Performance - Kaggle Post-competition analysis, top 6% rank.

Highly imbalance data, ratio is 1000 : 1, 10 GB dataset size. And the data is 50% missing value. More than 4000 variables, but I build models by only 50 features.

Rossmann Store Sales - Kaggle 

Post-competition analysis, top 10% rank.

Time series problem. Building models predict sales after 48 days.

Grupo Bimbo Inventory Demand - Kaggle

Post-competition analysis, top 8% rank. 

Time series problem, eighty millions data size. Building models predict inventory demand after 2 weeks.

Instacart Market Basket Analysis - Kaggle

Real competition, top 25% rank. 

Predicting which products will an consumer purchase again.


 Verification code to text

Create python package of Taiwan Train Verification Code to text.

The model is made by keras-CNN.

Skills

Distributed Queue System

1. Rabbitmq & Celery & Flower. 

2. 8 nodes ( Cloud ) distributed queue system for web crawling. 

3. Deploy by Docker and GKE.

4. Graceful Shutdown.

Database

1. MySQL ( RDBMS ). 

2. Redis ( NoSQL ). 

3. Dolphindb ( TSDB ).

GCP

1. Pub/Sub.
2. GKE ( K8S ).
3. GCE.
4. BQ.
5. Composer.
6. MemoryStore.

CI/CD

1. Create automated tests and automated deploy for the FinMind team. 

2. Using gitlab runner. 

3. CD for auto publish python package. 

4. CD for auto update and deploy new version service.

Log Collect & Monitor

1. Distributed system log collect by elk.  

2. Prometheus and Grafana. Monitor user usage, request latency, request count 

3. Monitor by telegram bot and slackbot.

4. Monitor vm and container by Netdata and cadvisor.


data pipeline

1. Design data pipeline for crawler, backend and analysis by airflow.
2. Design more 200 ETL by airflow.
3. Build airflow by composer
4. Build a real-time pipeline for sending push notifications to users

Machine Learning

xgboost, random forest, svm. statistics - ols, lasso.

Web Crawling

1. Python - request, BeautifulSoup, lxml, selenium. 

2. Auto recognition captcha code by CNN model.

Data Mining

Python - numpy, pandas, sklearn. 

R - parallel, dplyr, data.table, mice.

WEB

1. https://finmindtrade.com/ 

2. nginx

3. frontend - vue 

4. backend - python 

5. traefik.

API

1. FastAPI.
2. Websocket.
3. Loading Balance.
4. Async.
5. Graceful Shutdown.

Stress Test 

1. ApacheBench.
2. Upper bound of FinMind api is 8000/minute request.


Education

National Dong Hwa University, Master of Science,  Sep. 2017.

Major : Mathematics and Statistics.

Tamkang University. Bachelor of Science, Sep. 2015.

Major : Mathematics

Languages

R, Python. Basic in English and proficient in Chinese.