Avatar of Aiden Wu.
Aiden Wu
Data Engineer / Machine Learning Engineer
列印
Avatar of the user.

Aiden Wu

Data Engineer / Machine Learning Engineer
• Enthusiastic software developer: focus on distributed systems, especially Hadoop ecosystem • Experience in data engineering: develop batch and real-time data pipelines with an average of TBs per month via Spark and Airflow • Experience in machine learning: develop machine learning (ML) and deep learning (DL) models while providing services on RESTful API
Logo of the organization.
Garena
Logo of the organization.
National Cheng Kung University
Taipei, Taiwan

职场能力评价

专业背景

  • 目前状态
    就职中
  • 专业
    数据工程师
    大数据开发人员
    机器学习工程师
  • 产业
    半导体
    游戏
  • 工作年资
    4 到 6 年 (4 到 6 年相关工作经验)
  • 管理经历
  • 技能
    Python
    Spark
    Machine Learning
    Data Engineering
    Scala
    Hadoop
    Airflow
    Kafka
    Redis
    Go
  • 语言能力
    Chinese
    母语或双语
    English
    进阶
  • 最高学历
    硕士

求职偏好

  • 预期工作模式
    全职
    对远端工作有兴趣
  • 希望获得的职位
    Data engineer
  • 期望的工作地点
    Taipei, 台灣
  • 接案服务
    不提供接案服务

工作经验

Logo of the organization.

Senior Data Engineer

Garena
全职
2021年8月 - 现在
台灣台北市
• Build and manage self-distributed systems (e.g., Hadoop, Spark, and Kafka Cluster) • Design data warehouse and provide more than 50 ETL pipelines for various game operations • Collaborate with data scientists to optimize ML models, pipelines, and services • Refactor ML projects by improving software design for easier to reuse and adaptation • Develop internal config service based on RESTful API via Go and Docker
Logo of the organization.

Machine Learning Engineer

2017年12月 - 2021年4月
3 年 5 个月
- ML Pipelines Development: I was in charge of building the ML workflow for parameter tuning of etching. After working with domain experts and extracting a variety of tool data for 6 months, the success rate jumped to 80% from 30%. - DL Model Development and Deployment: Implemented DL methods and provided service based on the internal RESTful API for detecting the quality of SEM/TEM image and rotating skewed TEM images to fit the auto-measure process. - ML Platform Management: Responsible for maintaining applications, i.e. Jupyter, Python, Spark and many other internal development tools on Linux & Windows servers managed by the ML Platform Team. We developed and promoted our ML platform that aimed for servicing 300+ internal users. - Python Programming and ML skills Instructor: Provided internal consultation for most Python-related problems for all levels of management, including designing Python and ML courses for cross-departmental task forces and newcomers.
Logo of the organization.

Data Analyst

2017年4月 - 2017年7月
4 个月
• Built data processing pipelines with database MySQL, MongoDB and HDFS by Apache Spark. • Developed data processing of statistics summary and basic ML algorithm with Apache Spark, which produces the same result as Panda, a Python-based data analysis tool.
Logo of the organization.

Data Engineer - Internship

2015年7月 - 2016年2月
8 个月
• Coworked with many interdisciplinary talents to implement experimental and tactical marketing schemes, i.e. providing structural and valuable data for business development purposes and developing ML models to predict user behaviours, such as apps downloading.

学历

Logo of the organization.
Master’s Degree
Department of Electrical Engineering
2014 - 2016
活动和社团
NCKU TechOrange - Leader Introduction: • Foundation motivated by TechOrange • Co-founded by 6 NCKU transdisciplinary students interested in Data Science and Machine Learning. Activities & Events: • I organised this multidisciplinary learning group. Six of us took turns leading discussions on a variety of data science topics, including ML, algorithm among others. • Participated in conferences, lectures, and competitions related to data science.
Logo of the organization.
Bachelor’s Degree
B.S in Department of Engineering Science
2010 - 2014
活动和社团
Student Union International Relations Department - Director • 2013 International Student Club Exchange: We invited 25 students from Kanazawa University, Japan, to Taiwan for a seven-day cultural exchange and music performances. • 2014 Tainan Model United Nations: I was the organiser of the reception for 200+ participants from around 30 local universities.