- Jobs
ResumeCreate your job-winning resume using our free resume builder.
PortfolioShowcase your skills and projects with a professional portfolio.ResumeCreate your job-winning resume using our free resume builder.Resume BuilderMake a resume for free.Resume TemplatesAccess our extensive library of professional & ready-to-use templates.Resume ExamplesGet inspired by real resume examples to create your own.Occupation GuideAccess resume writing guides tailored for different professions.Resume HelpGet expert advice on all things resume from our team of recruitment specialists.- ResourcesSuccess StoriesBusiness ExcellenceAbout CakeResumeFeatured Reads
- Hire
- Download our App
CakeResume Talent Search
Advanced filters
On
4-6 years
6-10 years
10-15 years
More than 15 years
Data Engineer @Tesla2023 ~ 2023
・
Data engineer / Data anyayst
Within two months
data that included geo-location data from BigQuery and deployed it on the GCP environment. The API saved 80% of the time on fetching data (Cloud Run, IAM, BigQuery) 十月七月 2021 Data engineer • 富盈數據 Maintained distributed system and database • Constructed and managed the Hadoop ecosystem with Ambari. Built ETL pipeline to query multi-source database which processing more than three terabytes (TB) provided 90% of the analysis needs (Hive, HBase, Python, ELK, MySQL) • Established data collection and analysis workflow, saving Data scientists’ 30% of the time to analyze and build machine learning
Employed
・
Ready to interview
Full-time / Interested in working remotely
4-6 years
University of Texas at Dallas
・
Information Technology and Management
Principal Engineer, Data Engineering @KKCompany2023 ~ Present
・
Backend Engineer, Data Engineer, MLOps Engineer
Within one month
Chin-Hung (Wilson) Liu I am a lead architect responsible for designing and implementing a large-scale data pipeline for Lomotif, Paktor x 17LIVE, utilizing GCP/AWS/Python/Scala, in collaboration with data science and machine learning teams in Singapore and TW HQ, as well as with the Hadoop ecosystem (HDFS/HBase/Kafka) at JSpectrum in Hong Kong and Sydney. With over 15 years of experience in designing and developing Java/Scala/Python-based applications for daily operations, I bring: ● At least 8 years of experience in data analysis, pipeline design
Employed
・
Open to opportunities
Full-time / Interested in working remotely
10-15 years
National Taiwan University
・
EMBA Programs, Business Administration, Accounting, Finance and International Business.
Staff Cloud Architect Enginner @域動行銷股份有限公司2023 ~ Present
・
雲端工程師，雲端架構師，數據架構師
Within one month
及進步的團隊。 [email protected], Taiwan Education 輔仁大學圖書資訊學系,Skills Python 程式寫作、實作爬蟲及資料清理作業。 Database SQL : PostgreSQL, MySQL, MSSQL NoSQL: MongoDB, Redis, DynamoDB, Hadoop Docker 容器化技術 Data Lakehouse Databricks Azure 持有Microsoft Certified: Azure Solutions Architect Expert 及 Data enginner 證照 AWS 持有 AWS Certified Solutions Architect – Professional 證照 工作經歷 Staff Cloud Architect Enginner , 域動行銷股份有限
Employed
・
Not open to opportunities
Full-time / Interested in working remotely
4-6 years
輔仁大學
・
圖書資訊
Team Lead / Sr. Data Engineer @新加坡商競舞電競娛樂有限公司 Garena Online Private Ltd2021 ~ Present
・
資料工程師
Within one month
Employed
Full-time / Interested in working remotely
6-10 years
Senior Data Engineer @美光科技2021 ~ Present
・
Software Engineer / Backend Engineer / DevOps Engineer
Within six months
CD pipelines from scratch which follow GitOps flow and deploying service to GKE cluster using Helm . Familiar with GCP service , IAM, GCS, Big Query, Cloud Function, Pub/Sub, Cloud Scheduler Data Engineer Micron OctOct 2021 Taichung, Taiwan Developed and maintained ETL processes using Python to transfer data into Hadoop Ecosystem, including HBase and Hive, for efficient data storage and retrieval. Proficient in SQL for data manipulation and query optimization. Collaborated with cross-functional teams to design and implement data pipelines, ensuring data integrity and accuracy. Streamlined data processing workflows, resulting in significant time and resource
Employed
Full-time / Remote Only
4-6 years
National Chiao Tung University
・
資訊管理學系
Senior Data Engineer @Garena2021 ~ Present
・
Data engineer
Within one year
Aiden Wu Data Engineer / Machine Learning Engineer Taipei, Taiwan • Enthusiastic software developer: focus on distributed systems, especially Hadoop ecosystem • Experience in data engineering: develop batch and real-time data pipelines with an average of TBs per month via Spark and Airflow • Experience in machine learning: develop machine learning (ML) and deep learning (DL) models while providing services on RESTful API https://www.slideshare.net/ssuserf88631/presentations 工作經歷 Senior Data Engineer • Garena 八月Present • Build and manage self-distributed systems (e.g., Hadoop, Spark, and Kafka Cluster) • Design
Employed
Full-time / Interested in working remotely
4-6 years
National Cheng Kung University
・
Department of Electrical Engineering
Senior Data Engineer @Microsoft2021 ~ Present
・
資料科學家、資料工程師、資料分析師
Within one month
Ching-Chuan Chen 陳慶全 資料科學家、資料工程師、資料分析師 • City, TW • [email protected] Data engineer and data scientist with over four half years of experience. Proven success in processing big volume of data (6TB per day) in Spark in Scala and MPI in R and Python, developing a machine learning model with Spark in Scala on 30 billions of records for IoT device recognition and developing algorithms to classify unlabeled network behaviors of customers to protect their devices from compromising. Skilled in programming
Employed
Full-time / Interested in working remotely
4-6 years
National Cheng Kung University,
・
StatisticsEmployed
Full-time / Interested in working remotely
10-15 years
Jr. Programmer @德義資訊股份有限公司2013 ~ 2015
・
Developer Team Leader, Architect, FullStack Developer
More than one year
Employed
Full-time / Interested in working remotely
6-10 years
National Taiwan University
・
Bachelor of Bio-Industrial Mechatronics Engineering
Big data developer
More than one year
ZOOKEEPER. Summary Excellent understanding /knowledge on HADOOP(Gen-1 and Gen-2) and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, Resource Manager (YARN), Node Manager and Aplication Master. Expert in understanding the data and designing/implementing the enterprise platforms like Hadoop data lake and huge Data warehouses. Have over 2 years of experience as Hadoop Architect with very good exposure on Hadoop Technologies like HDFS, YARN, MapReduce, Sqoop, Flume, HBase, Hive, Presto, Oozie and Spark. Good understanding of NoSQL databases and hands on working experience in writing applications
Full-time / Interested in working remotely
6-10 years
JNTUH
・
Computer scienceThe Most Lightweight and Effective Recruiting Plan
Search resumes and take the initiative to contact job applicants for higher recruiting efficiency. The Choice of Hundreds of Companies.
- Browse all search results
- Unlimited access to start new conversations
- Resumes accessible for only paid companies
- View users’ email address & phone numbers
Search Tips
1
Search a precise keyword combination
senior backend php
2
Use quotes to search for an exact phrase
"business development"
3
Use the minus sign to eliminate results containing certain words
UI designer -UX
Only public resumes are available with the free plan.
Upgrade to an advanced plan to view all search results including tens of thousands of resumes exclusive on CakeResume.
Definition of Reputation Credits
Technical Skills
Specialized knowledge and expertise within the profession (e.g. familiar with SEO and use of related tools).
Problem-Solving
Ability to identify, analyze, and prepare solutions to problems.
Adaptability
Ability to navigate unexpected situations; and keep up with shifting priorities, projects, clients, and technology.
Communication
Ability to convey information effectively and is willing to give and receive feedback.
Time Management
Ability to prioritize tasks based on importance; and have them completed within the assigned timeline.
Teamwork
Ability to work cooperatively, communicate effectively, and anticipate each other's demands, resulting in coordinated collective action.
Leadership
Ability to coach, guide, and inspire a team to achieve a shared goal or outcome effectively.
Within one month
Sr. Data Engineer / Team Lead
新加坡商競舞電競娛樂有限公司 Garena Online Private Ltd
・
2021 ~ Present
Professional Background
Current status
Employed
Job Search Progress
Professions
Other
Fields of Employment
Work experience
6-10 years
Management
I've had experience in managing 1-5 people
Skills
Languages
Chinese
・
Native or Bilingual
English
・
Fluent
Job search preferences
Positions
資料工程師
Job types
Full-time
Locations
Taipei, 台灣
Remote
Interested in working remotely
Freelance
Educations
School
Major
Yi-Lun Wu (Velen)
Summary
- 7+ years of experience in big data fields both Cloud(GCP, AWS) and on-premised (Cloudera CDH).
- Develop data catalog with hybrid cloud environment(on-perm+AWS) for global commerce at Yahoo.
- Lead a machine learning team to build up offline/real-time platforms for recommendation systems from scratch at Garena.
- Lead and architect large-scale data pipelines/warehouses from Innova Solutions(AWS) and 17LIVE (GCP). And Cooperate with data science/machine learning team/TW HQ data team.
- Expert of Hadoop ecosystems such as HDFS/Hive/Hbase/Spark in Athemaster and Xuenn.
Sr. Big Data Engineer / Team Lead
Taoyuan，TW
[email protected]
Skills
Languages
- Python
- SQL
- Linux Shell Script
- Scala
Big Data Solutions
- Cloudera CDH
- Hadoop echosystems
- AWS EMR
- GCP Dataporc
Data Warehouse
- Hive
- Google BigQuery
- MySQL
- HBase
- Clickhouse
- AWS RDS
- AWS Athena
ETL Skills in Big Data
- Spark / Spark Streaming
- Hive (for ELT)
- Impala
- Kafka
- Cloud DataFlow (GCP)
Workflow Skills
- Airflow
- Digdag
- NiFi
- AWS CloudFormation
Other Skills
- Great communication
- Leaderships
- Scrum
- JIRA
- Linux
- Git
Experience
Senior Engineer at Yahoo．Jan, 2023 - Present
Working at Yahoo. The greatest challenge lies in developing in response to rapid market changes, where the data catalog needs to integrate with various complex systems. Simultaneously, maintaining the highest stability and ensuring high-quality data is essential.
More responsibilities/details as below.
- Fetch providers data with various way via Java. Such as fetching data from client's API, GraphQL, FTP, S3 or GCP... etc.
- standardizing data from above to feed into data warehouse in Hadoop/Hive/HBase using Spark.
- Implement a checking system to guarantee high quality data via Java.
- Migrate part of services from on-perm(Hadoop) to cloud(AWS) to become a hybrid cloud environment.
Senior Data Engineer/ Team Lead, at BOOYAH! Live Garena．Oct, 2021 - Sep, 2022
Working at ML team as a first data engineer. The challenge include build up data warehouse/pipeline from scratch. And design the data flow to support both batch/real-time recommendation systems.
More responsibilities/details as below.
- Design data model from scratch and Manage Hadoop based data warehouse for the training system.
- Develop streaming ETL pipeline via Spark from Message queue(Kafka) into in-memory data structure store(Redis) and ClickHouse for real-time recommendation system.
- Design ELT job for offline report system in Hadoop/Hive using Spark.
- Build up monitoring dashboard on Grafana.
- Take leadership on TW side.
Senior Data Engineer at 17 Media．Jun, 2020 - Oct, 2021
The big challenge of 17 Media data teams is facing fast-growing data volume (processing 5-10x TB level daily), complex cooperation with stakeholders, the cost optimization of pipeline and refactor big latency systems .etc.
More responsibilities/details as below.
- Manage Google BigQuery based data warehouse/lake.
- Refactory architecture of data warehouse to enhance 2x performance.
- Develop batch/streaming ETL pipeline to process data from diverse data sources(e.g. MongoDB, MySQL, APIs) into GCP.
- Design workflow using Digdag.
- Implement CI/CD on BIgQuery.
- Build up visualization tool(Superset) via Kubernetes.
- Well leadership and guiding junior members.
Senior Software Engineer at Innova Solutions Ltd．Oct, 2018 - May, 2020
Development Intelligent Healthcare Data Platform(IHDP) for empowering compony solutions using AWS service.
More responsibilities/details as below.
- Build APIs to the processing of patient records and providing access for downstream usages.
- Build Infrastructure on AWS and compliance for HIPPA and GDPR standard.
IT Consultant at Xuenn Pte Ltd．May, 2018 - Sep, 2018
The biggest challenge in Xuenn is facing performance issues in the original data warehouse. And I lead a project to build up a Hadoop cluster to reduce original EDW loading and improve various data pipelines.
More responsibilities/details as below.
- Perform adopting new technologies to implant into, to fuse into or to replace with existing systems for gaining leaps in performance, benefits and capabilities of the users.
- Building-up multiple systems and integrating with existing system, implemented Hadoop, data mining or data warehouse systems.
- Design an architecture which processing real-time data end-to-end using various Hadoop solutions without coding.
Software Engineer at Athemaster Co., Ltd．Jan, 2016 - Apr, 2018
Athemaster is a technology company offering solutions and expertise in implementing Enterprise Data Hub and automating Data integration with Open Source technologies such as Apache Hadoop and Spark.
More responsibilities/details as below.
- Focus on Enterprise Big Data solution such as Hadoop and Spark (Cloudera CDH).
- Maintain and improved other companies' Hadoop cluster.
- Help other companies integrate with Hadoop and resolved the technical issues.
- Build data pipelines via python ETL data to Hadoop.
Certification and License
CCA-175: CCA Spark and Hadoop Developer
Education
Undergraduate studies at Tamkang University, with a concentration in Department of Management Sciences.
2008 - 2012
Yi-Lun Wu (Velen)
Summary
- 7+ years of experience in big data fields both Cloud(GCP, AWS) and on-premised (Cloudera CDH).
- Develop data catalog with hybrid cloud environment(on-perm+AWS) for global commerce at Yahoo.
- Lead a machine learning team to build up offline/real-time platforms for recommendation systems from scratch at Garena.
- Lead and architect large-scale data pipelines/warehouses from Innova Solutions(AWS) and 17LIVE (GCP). And Cooperate with data science/machine learning team/TW HQ data team.
- Expert of Hadoop ecosystems such as HDFS/Hive/Hbase/Spark in Athemaster and Xuenn.
Sr. Big Data Engineer / Team Lead
Taoyuan，TW
[email protected]
Skills
Languages
- Python
- SQL
- Linux Shell Script
- Scala
Big Data Solutions
- Cloudera CDH
- Hadoop echosystems
- AWS EMR
- GCP Dataporc
Data Warehouse
- Hive
- Google BigQuery
- MySQL
- HBase
- Clickhouse
- AWS RDS
- AWS Athena
ETL Skills in Big Data
- Spark / Spark Streaming
- Hive (for ELT)
- Impala
- Kafka
- Cloud DataFlow (GCP)
Workflow Skills
- Airflow
- Digdag
- NiFi
- AWS CloudFormation
Other Skills
- Great communication
- Leaderships
- Scrum
- JIRA
- Linux
- Git
Experience
Senior Engineer at Yahoo．Jan, 2023 - Present
Working at Yahoo. The greatest challenge lies in developing in response to rapid market changes, where the data catalog needs to integrate with various complex systems. Simultaneously, maintaining the highest stability and ensuring high-quality data is essential.
More responsibilities/details as below.
- Fetch providers data with various way via Java. Such as fetching data from client's API, GraphQL, FTP, S3 or GCP... etc.
- standardizing data from above to feed into data warehouse in Hadoop/Hive/HBase using Spark.
- Implement a checking system to guarantee high quality data via Java.
- Migrate part of services from on-perm(Hadoop) to cloud(AWS) to become a hybrid cloud environment.
Senior Data Engineer/ Team Lead, at BOOYAH! Live Garena．Oct, 2021 - Sep, 2022
Working at ML team as a first data engineer. The challenge include build up data warehouse/pipeline from scratch. And design the data flow to support both batch/real-time recommendation systems.
More responsibilities/details as below.
- Design data model from scratch and Manage Hadoop based data warehouse for the training system.
- Develop streaming ETL pipeline via Spark from Message queue(Kafka) into in-memory data structure store(Redis) and ClickHouse for real-time recommendation system.
- Design ELT job for offline report system in Hadoop/Hive using Spark.
- Build up monitoring dashboard on Grafana.
- Take leadership on TW side.
Senior Data Engineer at 17 Media．Jun, 2020 - Oct, 2021
The big challenge of 17 Media data teams is facing fast-growing data volume (processing 5-10x TB level daily), complex cooperation with stakeholders, the cost optimization of pipeline and refactor big latency systems .etc.
More responsibilities/details as below.
- Manage Google BigQuery based data warehouse/lake.
- Refactory architecture of data warehouse to enhance 2x performance.
- Develop batch/streaming ETL pipeline to process data from diverse data sources(e.g. MongoDB, MySQL, APIs) into GCP.
- Design workflow using Digdag.
- Implement CI/CD on BIgQuery.
- Build up visualization tool(Superset) via Kubernetes.
- Well leadership and guiding junior members.
Senior Software Engineer at Innova Solutions Ltd．Oct, 2018 - May, 2020
Development Intelligent Healthcare Data Platform(IHDP) for empowering compony solutions using AWS service.
More responsibilities/details as below.
- Build APIs to the processing of patient records and providing access for downstream usages.
- Build Infrastructure on AWS and compliance for HIPPA and GDPR standard.
IT Consultant at Xuenn Pte Ltd．May, 2018 - Sep, 2018
The biggest challenge in Xuenn is facing performance issues in the original data warehouse. And I lead a project to build up a Hadoop cluster to reduce original EDW loading and improve various data pipelines.
More responsibilities/details as below.
- Perform adopting new technologies to implant into, to fuse into or to replace with existing systems for gaining leaps in performance, benefits and capabilities of the users.
- Building-up multiple systems and integrating with existing system, implemented Hadoop, data mining or data warehouse systems.
- Design an architecture which processing real-time data end-to-end using various Hadoop solutions without coding.
Software Engineer at Athemaster Co., Ltd．Jan, 2016 - Apr, 2018
Athemaster is a technology company offering solutions and expertise in implementing Enterprise Data Hub and automating Data integration with Open Source technologies such as Apache Hadoop and Spark.
More responsibilities/details as below.
- Focus on Enterprise Big Data solution such as Hadoop and Spark (Cloudera CDH).
- Maintain and improved other companies' Hadoop cluster.
- Help other companies integrate with Hadoop and resolved the technical issues.
- Build data pipelines via python ETL data to Hadoop.
Certification and License
CCA-175: CCA Spark and Hadoop Developer
Education
Undergraduate studies at Tamkang University, with a concentration in Department of Management Sciences.
2008 - 2012