CakeResume Talent Search

and collaborate with a dynamic team. New Taipei City, Taiwan Work Experience Data Engineer • Groundhog Technologies Inc. JulyPresent - Built and maintained data piplines (through which several hundred millions rows of data flow through daily) using Scala Spark/ Hadoop - Managed cron jobs and performed regular data recovery using Apache Airflow - Performed regular Extract, transform, load (ETL) operations through Hive and HDFS command line interfaces - Utilized streaming technologies such as Kafka to store data into various pools and lakes alike Graduate Hourly employee • University of Illinois at Urbana-Champaign SeptemberDecember 2020 Designed and developed student assessments/assignments for

import traditional CSV files. Utilized Databricks for large-scale data processing, leveraging its Spark capabilities to efficiently transform and aggregate incoming data streams. With the combined power of Databricks and AWS Lambda, ensured unparalleled data consistency, quality, and preparedness for sophisticated analytics and reporting. Utilized Databricks and Airflow to run extensive data profiling tasks, analyzing data patterns and identifying potential quality issues before they reached the Databricks Delta Lake. Established robust guardrails using the combined might of AWS Lambda, Apache Airflow and Databricks, ensuring that data stored in the DataBricks Delta Lake consistently met the highest

stable api under high qps with load testing / concurrent testing. Software engineer • Gogoro/Goshare • 2019/11~2022/01 ．Implement Tarjan's strongly connected component algorithm and topological sort algorithm in the task management system. ．Develop a customized synchronizer system by combining core concepts from Apache Airflow and Apache Kafka Connecter . ．Experience in performance test , load test and stress test and unit test. ．Experience in solving java native memory leak in JIT c2 level 4 compiler issue. Software Engineer • Lang Live • 2019/03 ~ 2019/10 ．Deal with 10 million+

Engineer (Amazon Ads) • Intomarkets AprilOct 2022 Responsible for dynamic data collection from Amazon Ad server, processing and storing in S3 bucket. Building and maintaining ML models and project pipelines such as time series modelling (e.g. Budget Shifting) Work extensively with Python, PySpark, Sklearn, TensorFlow, Plotly, Docker, Apache Airflow, ETL and Linux/ Windows os for prototyping and model building Quick prototyping of MVP and exploratory analysis Working knowledge with MLflow, Amazon advertising API and postman Deployment with docker and CI/CD pipelines CONTRIBUTION: Lead and built an in-house dynamic data collection tool with the

料抓取與邏輯計算，最後將資料以網頁呈現至前端‧ 這整套系統自建於Linode的雲端主機，使用UbuntuLTS系統環境，安裝包括nginx, mysql, phpmyadmin, python, apache airflow ‧ Apache airflow 曾經的踩雷: 1. 每次跑task時都會讓Scheduler與Mysql Crash，查 Mysql log之後發現好像是主機記憶體 不足 的問題，把linode的主機從RAM

. # Air quality real-time monitoring mapUtilized the ASP.NET MVC framework for building a low-cost PM2.5 sensing platform for the Environment Protection Administration Executive Yuan R.O.C. 2. Integrated Google Maps API to display GIS base data, and leveraged Apache EChart to present historical data. 3. Developed a Messenger Bot to provide convenient data querying services. EducationAppWorks School Blockchain Program國立暨南國際大學(National Chi Nan University) 資訊管理學系國立暨南國際大學

創建團隊完成資訊系統的跨平台移植和功能進化 New Taipei City, Taiwan 工作經歷 高級工程師 • 露天市集 六月至今 成功實作整合了 Kubernetes、Airflow、Gitlab、Gitlab Runner 和 Docker Registry 的微服務系統架構 。 重構 TensorFlow Model Server AI 專案，實作 gRPC 協定減少通訊延遲 。 使用 PySpark 和 Apache Beam 處理深度學習的億級資