CakeResume Talent Search

Advanced filters
On
4-6 years
6-10 years
10-15 years
More than 15 years
Avatar of Yiru Chen.
Avatar of Yiru Chen.
資料工程師 @鴻海(富士康)
2021 ~ Present
資料工程師/網路爬蟲、後端工程師、軟體工程師、網管
Within one month
Uvicorn, Gunicorn 開發RESTful API 及設計 MongoDB schema並使用 Docker-compose 進行開發與部署- 負責開發資料庫 Connector 操作頁面(支援 Impala, Kudu, PostgreSQL, MySQL, MS SQL, Oracle)、 Record Controller 功能、平台 Pipeline 中檢視資料的視覺化功能,以及熟悉 Nifi 各種Processor 功能加入系統中 - 協助用戶建置及改善 ETL Pipeline 效能 Line Notify 服務系統: - 設計系統
Python
SQL
Git
Employed
Ready to interview
Full-time / Interested in working remotely
4-6 years
國立成功大學
統計研究所
Avatar of the user.
Avatar of the user.
Data Engineer @FarEasTone Telecom
2021 ~ Present
Data engineer
Within one month
Python
Azure
DataBricks
Employed
Full-time / Interested in working remotely
6-10 years
National Chung Cheng University
Applied Geophysics
Avatar of 陳柄宏.
Avatar of 陳柄宏.
Staff Cloud Architect Enginner @域動行銷股份有限公司
2023 ~ Present
雲端工程師,雲端架構師,數據架構師
Within one month
Solutions Architect CKmates Responsible for AWS cloud architecture and solution design. AprJan 2023 Cloud Data Engineer SinYi Realty Inc. Responsible for Azure cloud architecture and Data ETL Pipeline development and management. JanApr 2022 Backend Engineer AnFu Solutions Inc. Responsible for AWS cloud environment management and architecture, ETL data cleaning, and Python API development. Project experience: House+ : Data cleaning process management, using Elastic Beanstalk in the AWS cloud environment to establish a data cleaning process pipeline. Model training process management, using Elastic Beanstalk in the AWS cloud environment to establish a model training process
git
hadoop ecosystem
MongoDB
Employed
Not open to opportunities
Full-time / Interested in working remotely
4-6 years
輔仁大學
圖書資訊
Avatar of the user.
Avatar of the user.
Senior Data Scientist @TeamViewer GmbH
2021 ~ Present
Data Scientist
Within one month
Python
C++
Docker
Employed
Not open to opportunities
Full-time / Interested in working remotely
4-6 years
University of Paderborn
Computer Engineering
Avatar of 陳婉玲.
Avatar of 陳婉玲.
Analyst @Business Next Media Corp.
2017 ~ 2019
Data Analyst、Data Engineer、Data Scientist、Customer Experience Analyst
Within one month
for business process automation using data techniques on loan, credit analysis and procurement process. • Design solutions for data leakage prevention and data security. • Implement end-to-end generative AI solution integrating with GraphDB, Chatbot & Avatar. Morrison Express Corp., Data Engineer, Jan 2021 ~ Jul 2022 • Orchestrated data pipeline, ETL process and API to connect diverse data systems and facilitate data migration. • Full accountability for overseeing data architecture and services spanning 70 offices across five continents. • Integrated AWS cloud services, optimizing applications with S3, Lambda, SQS, SNS, and ECS. ASUSTeK Computer Inc., Digital Analyst
Python
SQL/MySQL
Databases
Employed
Full-time / Interested in working remotely
4-6 years
National Taiwan University
Psychology
Avatar of the user.
Avatar of the user.
Past
Senior Systems Analyst @日本NEC集團_統智科技股份有限公司
2022 ~ 2023
Technical Lead
Within one month
AWS
Angular
Dotnet
Unemployed
Open to opportunities
Full-time / Not interested in working remotely
6-10 years
德明財經科技大學
資訊管理
Avatar of Jason Chang.
Avatar of Jason Chang.
Senior Software Engineer @Innova Solutions Taiwan
2019 ~ Present
Backend developer/Full-stack developer
Within one month
Git #Bootstrap #HTML/CSS #SpringBoot #PlayFramework #CodeIgniter #Tomcat #Jersey #Jetty Work Experience Senior Software Engineer • Innova Solutions Taiwan 2023/03 - Present Data Platform - Alchemy Team 1. The key person to create an automation testing framework for cross-team spark ETL modules. 2. Using Gitlab-CI to streamline the upstream and downstream projects across different teams. 3. Create and design the test plan based on Gitflow. 4. Create the activity log reporter in the pipeline using SNS. 5. Remove the Glue crawler
Java
Scala
JavaScript
Employed
Not open to opportunities
Full-time / Interested in working remotely
6-10 years
國立中興大學 (National Chung Hsin University, NCHU)
資訊管理
Avatar of Arthur Ma.
Avatar of Arthur Ma.
DevOps @nodereal
2022 ~ Present
SRE /DevOps engineer
Within one month
to the old version of the homepage of the Bank. They have successfully provided about 300,000 business conversions every month, including online card applications, asset products, trading services, etc, s ince the service was launched inAugMay 2020 R&D LoFTechnology, inc Transformation of VM-based service into Kubernetes on production From zero to one research task, and mentor other team members Kubernetes/ansible/drone/bitbucket-pipeline On-premise Kubernetes cluster deploys solution provider. Resolving production service performance issues Implement container base CI/CD pipeline replacing legacy manual deploy Launch a...
kubernetes
Golang
Cloud Native Application
Employed
Not open to opportunities
Full-time / Interested in working remotely
6-10 years
元智大學 Yuan Ze University
CSE
Avatar of Ryan.
Algorithm Engineer/ Data Scientist/ Sr. Project Management
More than one year
in practical scenarios, it's surprising to see some fundamental algorithms can show us more insights. PySpark dataframe programming Recommendation algorithm design, improved and achieved the best performance at that tim e Various classification tasks User profile construction with NLP. Information retrieval based chat bot Data warehousing and ETL management (Febnow) I created some tools(e.g., airfly ) to help us management our data more efficiently. Based on PySpark Auto DAG generator : automatically resolve and build the task dependencies for our data pipeline Metadata management. More easier to perform data analytics such as EDA
Python
Pyspark
Natural Language Processing
Full-time / Remote Only
4-6 years

The Most Lightweight and Effective Recruiting Plan

Search resumes and take the initiative to contact job applicants for higher recruiting efficiency. The Choice of Hundreds of Companies.

  • Browse all search results
  • Unlimited access to start new conversations
  • Resumes accessible for only paid companies
  • View users’ email address & phone numbers
Search Tips
1
Search a precise keyword combination
senior backend php
If the number of the search result is not enough, you can remove the less important keywords
2
Use quotes to search for an exact phrase
"business development"
3
Use the minus sign to eliminate results containing certain words
UI designer -UX
Only public resumes are available with the free plan.
Upgrade to an advanced plan to view all search results including tens of thousands of resumes exclusive on CakeResume.

Definition of Reputation Credits

Technical Skills
Specialized knowledge and expertise within the profession (e.g. familiar with SEO and use of related tools).
Problem-Solving
Ability to identify, analyze, and prepare solutions to problems.
Adaptability
Ability to navigate unexpected situations; and keep up with shifting priorities, projects, clients, and technology.
Communication
Ability to convey information effectively and is willing to give and receive feedback.
Time Management
Ability to prioritize tasks based on importance; and have them completed within the assigned timeline.
Teamwork
Ability to work cooperatively, communicate effectively, and anticipate each other's demands, resulting in coordinated collective action.
Leadership
Ability to coach, guide, and inspire a team to achieve a shared goal or outcome effectively.
Within two months
Sr. Data Engineer / Team Lead
Logo of 新加坡商競舞電競娛樂有限公司 Garena Online Private Ltd.
新加坡商競舞電競娛樂有限公司 Garena Online Private Ltd
2021 ~ Present
Taoyuan, 桃園區桃園市台灣
Professional Background
Current status
Employed
Job Search Progress
Professions
Other
Fields of Employment
Work experience
6-10 years
Management
I've had experience in managing 1-5 people
Skills
Hadoop
Spark
SQL
python
Scala
AWS
GCP
Languages
Chinese
Native or Bilingual
English
Fluent
Job search preferences
Positions
資料工程師
Job types
Full-time
Locations
Taipei, 台灣
Remote
Interested in working remotely
Freelance
Educations
School
Major
Print
Vxftskax4mfwtiqudlao

Yi-Lun Wu (Velen)

Summary

  • 7+ years of experience in big data fields both Cloud(GCP, AWS) and on-premised (Cloudera CDH). 
  • Develop data catalog with hybrid cloud environment(on-perm+AWS) for global commerce at Yahoo.
  • Lead a machine learning team to build up offline/real-time platforms for recommendation systems from scratch at Garena. 
  • Lead and architect large-scale data pipelines/warehouses from Innova Solutions(AWS) and 17LIVE (GCP). And Cooperate with data science/machine learning team/TW HQ data team.
  • Expert of Hadoop ecosystems such as HDFS/Hive/Hbase/Spark in Athemaster and Xuenn.

Sr. Big Data Engineer / Team Lead
Taoyuan,TW
[email protected]

Skills


Languages

  • Python 
  • SQL
  • Linux Shell Script
  • Scala


Big Data Solutions

  • Cloudera CDH
  • Hadoop echosystems
  • AWS EMR
  • GCP Dataporc


Data Warehouse

  • Hive
  • Google BigQuery
  • MySQL
  • HBase
  • Clickhouse
  • AWS RDS
  • AWS Athena


ETL Skills in Big Data

  • Spark / Spark Streaming
  • Hive (for ELT) 
  • Impala 
  • Kafka 
  • Cloud DataFlow  (GCP)


Workflow Skills

  • Airflow 
  • Digdag 
  • NiFi 
  • AWS CloudFormation


Other Skills

  • Great communication 
  • Leaderships 
  • Scrum 
  • JIRA 
  • Linux 
  • Git  

Experience

Senior Engineer at Yahoo.Jan, 2023 - Present

Working at Yahoo. The greatest challenge lies in developing in response to rapid market changes, where the data catalog needs to integrate with various complex systems. Simultaneously, maintaining the highest stability and ensuring high-quality data is essential. 

More responsibilities/details as below.
  • Fetch providers data with various way via Java. Such as fetching data from client's API, GraphQL, FTP, S3 or GCP... etc.
  • standardizing data from above to feed into data warehouse in Hadoop/Hive/HBase using Spark
  • Implement a checking system to guarantee high quality data via Java.
  • Migrate part of services from on-perm(Hadoop) to cloud(AWS) to become a hybrid cloud environment.

 

Senior Data Engineer/ Team Lead, at BOOYAH! Live Garena.Oct, 2021 - Sep, 2022

Working at ML team as a first data engineer. The challenge include build up data warehouse/pipeline from scratch. And design the data flow to support both batch/real-time recommendation systems.

More responsibilities/details as below.
  • Design data model from scratch and Manage Hadoop based data warehouse for the training system.
  • Develop streaming ETL pipeline via Spark from Message queue(Kafka) into in-memory data structure store(Redis) and ClickHouse for real-time recommendation system.
  • Design ELT job for offline report system in Hadoop/Hive using Spark.
  • Build up monitoring dashboard on Grafana
  • Take leadership on TW side.

Senior Data Engineer at 17 Media.Jun, 2020 - Oct, 2021

The big challenge of 17 Media data teams is facing fast-growing data volume (processing 5-10x TB level daily), complex cooperation with stakeholders, the cost optimization of pipeline and refactor big latency systems .etc.

More responsibilities/details as below. 
  • Manage Google BigQuery based data warehouse/lake. 
  • Refactory architecture of data warehouse to enhance 2x performance
  • Develop batch/streaming ETL pipeline to process data from diverse data sources(e.g. MongoDB, MySQL, APIs) into GCP
  • Design workflow using Digdag
  • Implement CI/CD on BIgQuery
  • Build up visualization tool(Superset) via Kubernetes
  • Well leadership and guiding junior members.

Senior Software Engineer at Innova Solutions Ltd.Oct, 2018 - May, 2020

Development Intelligent Healthcare Data Platform(IHDP) for empowering compony solutions using AWS service. 

More responsibilities/details as below. 
  • Build APIs to the processing of patient records and providing access for downstream usages.
  • Build Infrastructure on AWS and compliance for HIPPA and GDPR standard.

IT Consultant at Xuenn Pte Ltd.May, 2018 - Sep, 2018

The biggest challenge in Xuenn is facing performance issues in the original data warehouse. And I lead a project to build up a Hadoop cluster to reduce original EDW loading and improve various data pipelines.

More responsibilities/details as below.  
  • Perform adopting new technologies to implant into, to fuse into or to replace with existing systems for gaining leaps in performance, benefits and capabilities of the users. 
  • Building-up multiple systems and integrating with existing system, implemented Hadoop, data mining or data warehouse systems.
  • Design an architecture which processing real-time data end-to-end using various Hadoop solutions without coding. 

Software Engineer at Athemaster Co., Ltd.Jan, 2016 - Apr, 2018 

Athemaster is a technology company offering solutions and expertise in implementing Enterprise Data Hub and automating Data integration with Open Source technologies such as Apache Hadoop and Spark. More responsibilities/details as below.
  • Focus on Enterprise Big Data solution such as Hadoop and Spark (Cloudera CDH). 
  • Maintain and improved other companies' Hadoop cluster. 
  • Help other companies integrate with Hadoop and resolved the technical issues. 
  • Build data pipelines via python ETL data to Hadoop.

Certification and License


Readings 00 00@2x ce5676dabcce042724a6fc4c3413d6a86ad9c78eecb848896433e32c60b7006b


CCA-175: CCA Spark and Hadoop Developer



Readings 00 01@2x 77cc06c91fae4dd43a069fa4b813524cd022d4a79115524d3f0d6b9220dfd71d

Cloudera Certified Administrator for Hadoop

Education



Undergraduate studies at Tamkang University, with a concentration in Department of Management Sciences.

                                                                                                                                                                                                     2008 - 2012

Resume
Profile
Vxftskax4mfwtiqudlao

Yi-Lun Wu (Velen)

Summary

  • 7+ years of experience in big data fields both Cloud(GCP, AWS) and on-premised (Cloudera CDH). 
  • Develop data catalog with hybrid cloud environment(on-perm+AWS) for global commerce at Yahoo.
  • Lead a machine learning team to build up offline/real-time platforms for recommendation systems from scratch at Garena. 
  • Lead and architect large-scale data pipelines/warehouses from Innova Solutions(AWS) and 17LIVE (GCP). And Cooperate with data science/machine learning team/TW HQ data team.
  • Expert of Hadoop ecosystems such as HDFS/Hive/Hbase/Spark in Athemaster and Xuenn.

Sr. Big Data Engineer / Team Lead
Taoyuan,TW
[email protected]

Skills


Languages

  • Python 
  • SQL
  • Linux Shell Script
  • Scala


Big Data Solutions

  • Cloudera CDH
  • Hadoop echosystems
  • AWS EMR
  • GCP Dataporc


Data Warehouse

  • Hive
  • Google BigQuery
  • MySQL
  • HBase
  • Clickhouse
  • AWS RDS
  • AWS Athena


ETL Skills in Big Data

  • Spark / Spark Streaming
  • Hive (for ELT) 
  • Impala 
  • Kafka 
  • Cloud DataFlow  (GCP)


Workflow Skills

  • Airflow 
  • Digdag 
  • NiFi 
  • AWS CloudFormation


Other Skills

  • Great communication 
  • Leaderships 
  • Scrum 
  • JIRA 
  • Linux 
  • Git  

Experience

Senior Engineer at Yahoo.Jan, 2023 - Present

Working at Yahoo. The greatest challenge lies in developing in response to rapid market changes, where the data catalog needs to integrate with various complex systems. Simultaneously, maintaining the highest stability and ensuring high-quality data is essential. 

More responsibilities/details as below.
  • Fetch providers data with various way via Java. Such as fetching data from client's API, GraphQL, FTP, S3 or GCP... etc.
  • standardizing data from above to feed into data warehouse in Hadoop/Hive/HBase using Spark
  • Implement a checking system to guarantee high quality data via Java.
  • Migrate part of services from on-perm(Hadoop) to cloud(AWS) to become a hybrid cloud environment.

 

Senior Data Engineer/ Team Lead, at BOOYAH! Live Garena.Oct, 2021 - Sep, 2022

Working at ML team as a first data engineer. The challenge include build up data warehouse/pipeline from scratch. And design the data flow to support both batch/real-time recommendation systems.

More responsibilities/details as below.
  • Design data model from scratch and Manage Hadoop based data warehouse for the training system.
  • Develop streaming ETL pipeline via Spark from Message queue(Kafka) into in-memory data structure store(Redis) and ClickHouse for real-time recommendation system.
  • Design ELT job for offline report system in Hadoop/Hive using Spark.
  • Build up monitoring dashboard on Grafana
  • Take leadership on TW side.

Senior Data Engineer at 17 Media.Jun, 2020 - Oct, 2021

The big challenge of 17 Media data teams is facing fast-growing data volume (processing 5-10x TB level daily), complex cooperation with stakeholders, the cost optimization of pipeline and refactor big latency systems .etc.

More responsibilities/details as below. 
  • Manage Google BigQuery based data warehouse/lake. 
  • Refactory architecture of data warehouse to enhance 2x performance
  • Develop batch/streaming ETL pipeline to process data from diverse data sources(e.g. MongoDB, MySQL, APIs) into GCP
  • Design workflow using Digdag
  • Implement CI/CD on BIgQuery
  • Build up visualization tool(Superset) via Kubernetes
  • Well leadership and guiding junior members.

Senior Software Engineer at Innova Solutions Ltd.Oct, 2018 - May, 2020

Development Intelligent Healthcare Data Platform(IHDP) for empowering compony solutions using AWS service. 

More responsibilities/details as below. 
  • Build APIs to the processing of patient records and providing access for downstream usages.
  • Build Infrastructure on AWS and compliance for HIPPA and GDPR standard.

IT Consultant at Xuenn Pte Ltd.May, 2018 - Sep, 2018

The biggest challenge in Xuenn is facing performance issues in the original data warehouse. And I lead a project to build up a Hadoop cluster to reduce original EDW loading and improve various data pipelines.

More responsibilities/details as below.  
  • Perform adopting new technologies to implant into, to fuse into or to replace with existing systems for gaining leaps in performance, benefits and capabilities of the users. 
  • Building-up multiple systems and integrating with existing system, implemented Hadoop, data mining or data warehouse systems.
  • Design an architecture which processing real-time data end-to-end using various Hadoop solutions without coding. 

Software Engineer at Athemaster Co., Ltd.Jan, 2016 - Apr, 2018 

Athemaster is a technology company offering solutions and expertise in implementing Enterprise Data Hub and automating Data integration with Open Source technologies such as Apache Hadoop and Spark. More responsibilities/details as below.
  • Focus on Enterprise Big Data solution such as Hadoop and Spark (Cloudera CDH). 
  • Maintain and improved other companies' Hadoop cluster. 
  • Help other companies integrate with Hadoop and resolved the technical issues. 
  • Build data pipelines via python ETL data to Hadoop.

Certification and License


Readings 00 00@2x ce5676dabcce042724a6fc4c3413d6a86ad9c78eecb848896433e32c60b7006b


CCA-175: CCA Spark and Hadoop Developer



Readings 00 01@2x 77cc06c91fae4dd43a069fa4b813524cd022d4a79115524d3f0d6b9220dfd71d

Cloudera Certified Administrator for Hadoop

Education



Undergraduate studies at Tamkang University, with a concentration in Department of Management Sciences.

                                                                                                                                                                                                     2008 - 2012