You-En (Leo) Lin

Work Experience

Software Engineer  •  Crescendo Lab  Jul 2017 - Oct 2022  •  5 yr 3 mos
Python/Django/Airflow/dbt/PostgreSQL/Redis/BigQuery/GCP/Kubernetes

Data Engineer

Maintainer of data pipeline and database systems on GCP.

• Designed and built scalable data pipelines to process 2+ terabytes of data per day.
• Improved the stability and observability of the pipelines by applying Kubernetes and Grafana.

Backend Engineer

Be one of the first engineers and grew with the company from 4 to 50+ people. Maintainer of Web Service. Involved in projects focused on developing message marketing systems and integrating third-party CRM and message channels.

• Handle 7M+ requests and send 200M+ messages per day.
• Integrated several 10+ services such as GA, Shopline, 91APP, SurveyCake, E-Invoice, etc.
• Rewrote the backbone service and migrated the infrastructure from Heroku to GCP using Kubernetes.

Backend Engineer  •  Universe Tech  Nov 2018 - Jul 2019  •  8 mos
PHP/Laravel/MariaDB/Redis

Be one of the first engineers and design the overall architecture of the backend service.

• Built the CRM and customer service system for online games.
• Interview the junior engineers.

Project

Taiwan Stock Analytic Platform

Python/Airflow/dbt/TimescaleDB/ArgoCD/Kubernetes

• Built the data pipeline to fetch data from several sources, such as TWSE, TPEX, IStock, YFinance, etc.
• Utilized dbt to do ETL jobs and data validation.
• Deployed ArgoCD to self-manage and manage services such as Airflow, Redis, and Sentry on Kubernetes.

SEEN: Structured Event Enhancement Network for Explainable Need Detection of Information Recall Assistance

• Conducted NLP research on lifelogging and proposed a new topic about event-based memory recall system during my master program at NTU.
• Published the paper at EMNLP (one of the top NLP conferences).