Avatar of Aiden Wu.
Aiden Wu
Data Engineer / Machine Learning Engineer
列印
Avatar of the user.

Aiden Wu

Data Engineer / Machine Learning Engineer
• Enthusiastic software developer: focus on distributed systems, especially Hadoop ecosystem • Experience in data engineering: develop batch and real-time data pipelines with an average of TBs per month via Spark and Airflow • Experience in machine learning: develop machine learning (ML) and deep learning (DL) models while providing services on RESTful API
Logo of the organization.
Garena
Logo of the organization.
National Cheng Kung University
Taipei, Taiwan

職場能力評價

專業背景

  • 目前狀態
    就職中
  • 專業
    數據工程師
    大數據開發人員
    機器學習工程師
  • 產業
    半導體
    遊戲
  • 工作年資
    4 到 6 年 (4 到 6 年相關工作經驗)
  • 管理經歷
  • 技能
    Python
    Spark
    Machine Learning
    Data Engineering
    Scala
    Hadoop
    Airflow
    Kafka
    Redis
    Go
  • 語言能力
    Chinese
    母語或雙語
    English
    進階
  • 最高學歷
    碩士

求職偏好

  • 預期工作模式
    全職
    對遠端工作有興趣
  • 希望獲得的職位
    Data engineer
  • 期望的工作地點
    Taipei, 台灣
  • 接案服務
    不提供接案服務

工作經驗

Logo of the organization.

Senior Data Engineer

Garena
全職
2021年8月 - 現在
台灣台北市
• Build and manage self-distributed systems (e.g., Hadoop, Spark, and Kafka Cluster) • Design data warehouse and provide more than 50 ETL pipelines for various game operations • Collaborate with data scientists to optimize ML models, pipelines, and services • Refactor ML projects by improving software design for easier to reuse and adaptation • Develop internal config service based on RESTful API via Go and Docker
Logo of the organization.

Machine Learning Engineer

2017年12月 - 2021年4月
3 年 5 個月
- ML Pipelines Development: I was in charge of building the ML workflow for parameter tuning of etching. After working with domain experts and extracting a variety of tool data for 6 months, the success rate jumped to 80% from 30%. - DL Model Development and Deployment: Implemented DL methods and provided service based on the internal RESTful API for detecting the quality of SEM/TEM image and rotating skewed TEM images to fit the auto-measure process. - ML Platform Management: Responsible for maintaining applications, i.e. Jupyter, Python, Spark and many other internal development tools on Linux & Windows servers managed by the ML Platform Team. We developed and promoted our ML platform that aimed for servicing 300+ internal users. - Python Programming and ML skills Instructor: Provided internal consultation for most Python-related problems for all levels of management, including designing Python and ML courses for cross-departmental task forces and newcomers.
Logo of the organization.

Data Analyst

2017年4月 - 2017年7月
4 個月
• Built data processing pipelines with database MySQL, MongoDB and HDFS by Apache Spark. • Developed data processing of statistics summary and basic ML algorithm with Apache Spark, which produces the same result as Panda, a Python-based data analysis tool.
Logo of the organization.

Data Engineer - Internship

2015年7月 - 2016年2月
8 個月
• Coworked with many interdisciplinary talents to implement experimental and tactical marketing schemes, i.e. providing structural and valuable data for business development purposes and developing ML models to predict user behaviours, such as apps downloading.

學歷

Logo of the organization.
Master’s Degree
Department of Electrical Engineering
2014 - 2016
社團活動
NCKU TechOrange - Leader Introduction: • Foundation motivated by TechOrange • Co-founded by 6 NCKU transdisciplinary students interested in Data Science and Machine Learning. Activities & Events: • I organised this multidisciplinary learning group. Six of us took turns leading discussions on a variety of data science topics, including ML, algorithm among others. • Participated in conferences, lectures, and competitions related to data science.
Logo of the organization.
Bachelor’s Degree
B.S in Department of Engineering Science
2010 - 2014
社團活動
Student Union International Relations Department - Director • 2013 International Student Club Exchange: We invited 25 students from Kanazawa University, Japan, to Taiwan for a seven-day cultural exchange and music performances. • 2014 Tainan Model United Nations: I was the organiser of the reception for 200+ participants from around 30 local universities.