- Jobs
ResumeCreate your job-winning resume using our free resume builder.
PortfolioShowcase your skills and projects with a professional portfolio.ResumeCreate your job-winning resume using our free resume builder.Resume BuilderMake a resume for free.Resume TemplatesAccess our extensive library of professional & ready-to-use templates.Resume ExamplesGet inspired by real resume examples to create your own.Occupation GuideAccess resume writing guides tailored for different professions.Resume HelpGet expert advice on all things resume from our team of recruitment specialists.- ResourcesSuccess StoriesBusiness ExcellenceAbout CakeResumeFeatured Reads
- Hire
- Download our App
CakeResume Talent Search
Advanced filters
On
De 4 a 6 años
6-10 años
10-15 años
Más de 15 años
Data Engineer @Tesla2023 ~ 2023
・
Data engineer / Data anyayst
En el plazo de dos meses
data that included geo-location data from BigQuery and deployed it on the GCP environment. The API saved 80% of the time on fetching data (Cloud Run, IAM, BigQuery) 十月七月 2021 Data engineer • 富盈數據 Maintained distributed system and database • Constructed and managed the Hadoop ecosystem with Ambari. Built ETL pipeline to query multi-source database which processing more than three terabytes (TB) provided 90% of the analysis needs (Hive, HBase, Python, ELK, MySQL) • Established data collection and analysis workflow, saving Data scientists’ 30% of the time to analyze and build machine learning
Empleado
・
Listo para la entrevista
A tiempo completo / Interesado en trabajar a distancia
De 4 a 6 años
University of Texas at Dallas
・
Information Technology and Management
Principal Engineer, Data Engineering @KKCompany2023 ~ Presente
・
Backend Engineer, Data Engineer, MLOps Engineer
En un mes
Chin-Hung (Wilson) Liu I am a lead architect responsible for designing and implementing a large-scale data pipeline for Lomotif, Paktor x 17LIVE, utilizing GCP/AWS/Python/Scala, in collaboration with data science and machine learning teams in Singapore and TW HQ, as well as with the Hadoop ecosystem (HDFS/HBase/Kafka) at JSpectrum in Hong Kong and Sydney. With over 15 years of experience in designing and developing Java/Scala/Python-based applications for daily operations, I bring: ● At least 8 years of experience in data analysis, pipeline design
Empleado
・
Abierto a oportunidades
A tiempo completo / Interesado en trabajar a distancia
10-15 años
National Taiwan University
・
EMBA Programs, Business Administration, Accounting, Finance and International Business.
Staff Cloud Architect Enginner @域動行銷股份有限公司2023 ~ Presente
・
雲端工程師，雲端架構師，數據架構師
En un mes
及進步的團隊。 [email protected], Taiwan Education 輔仁大學圖書資訊學系,Skills Python 程式寫作、實作爬蟲及資料清理作業。 Database SQL : PostgreSQL, MySQL, MSSQL NoSQL: MongoDB, Redis, DynamoDB, Hadoop Docker 容器化技術 Data Lakehouse Databricks Azure 持有Microsoft Certified: Azure Solutions Architect Expert 及 Data enginner 證照 AWS 持有 AWS Certified Solutions Architect – Professional 證照 工作經歷 Staff Cloud Architect Enginner , 域動行銷股份有限
Empleado
・
No está abierto a oportunidades
A tiempo completo / Interesado en trabajar a distancia
De 4 a 6 años
輔仁大學
・
圖書資訊
Team Lead / Sr. Data Engineer @新加坡商競舞電競娛樂有限公司 Garena Online Private Ltd2021 ~ Presente
・
資料工程師
En un mes
Empleado
A tiempo completo / Interesado en trabajar a distancia
6-10 años
Senior Data Engineer @美光科技2021 ~ Presente
・
Software Engineer / Backend Engineer / DevOps Engineer
En seis meses
CD pipelines from scratch which follow GitOps flow and deploying service to GKE cluster using Helm . Familiar with GCP service , IAM, GCS, Big Query, Cloud Function, Pub/Sub, Cloud Scheduler Data Engineer Micron OctOct 2021 Taichung, Taiwan Developed and maintained ETL processes using Python to transfer data into Hadoop Ecosystem, including HBase and Hive, for efficient data storage and retrieval. Proficient in SQL for data manipulation and query optimization. Collaborated with cross-functional teams to design and implement data pipelines, ensuring data integrity and accuracy. Streamlined data processing workflows, resulting in significant time and resource
Empleado
A tiempo completo / Sólo a distancia
De 4 a 6 años
National Chiao Tung University
・
資訊管理學系
Senior Data Engineer @Garena2021 ~ Presente
・
Data engineer
En un año
Aiden Wu Data Engineer / Machine Learning Engineer Taipei, Taiwan • Enthusiastic software developer: focus on distributed systems, especially Hadoop ecosystem • Experience in data engineering: develop batch and real-time data pipelines with an average of TBs per month via Spark and Airflow • Experience in machine learning: develop machine learning (ML) and deep learning (DL) models while providing services on RESTful API https://www.slideshare.net/ssuserf88631/presentations 工作經歷 Senior Data Engineer • Garena 八月Present • Build and manage self-distributed systems (e.g., Hadoop, Spark, and Kafka Cluster) • Design
Empleado
A tiempo completo / Interesado en trabajar a distancia
De 4 a 6 años
National Cheng Kung University
・
Department of Electrical Engineering
Senior Data Engineer @Microsoft2021 ~ Presente
・
資料科學家、資料工程師、資料分析師
En un mes
Ching-Chuan Chen 陳慶全 資料科學家、資料工程師、資料分析師 • City, TW • [email protected] Data engineer and data scientist with over four half years of experience. Proven success in processing big volume of data (6TB per day) in Spark in Scala and MPI in R and Python, developing a machine learning model with Spark in Scala on 30 billions of records for IoT device recognition and developing algorithms to classify unlabeled network behaviors of customers to protect their devices from compromising. Skilled in programming
Empleado
A tiempo completo / Interesado en trabajar a distancia
De 4 a 6 años
National Cheng Kung University,
・
StatisticsEmpleado
A tiempo completo / Interesado en trabajar a distancia
10-15 años
Jr. Programmer @德義資訊股份有限公司2013 ~ 2015
・
Developer Team Leader, Architect, FullStack Developer
Más de un año
Empleado
A tiempo completo / Interesado en trabajar a distancia
6-10 años
National Taiwan University
・
Bachelor of Bio-Industrial Mechatronics Engineering
Big data developer
Más de un año
ZOOKEEPER. Summary Excellent understanding /knowledge on HADOOP(Gen-1 and Gen-2) and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, Resource Manager (YARN), Node Manager and Aplication Master. Expert in understanding the data and designing/implementing the enterprise platforms like Hadoop data lake and huge Data warehouses. Have over 2 years of experience as Hadoop Architect with very good exposure on Hadoop Technologies like HDFS, YARN, MapReduce, Sqoop, Flume, HBase, Hive, Presto, Oozie and Spark. Good understanding of NoSQL databases and hands on working experience in writing applications
A tiempo completo / Interesado en trabajar a distancia
6-10 años
JNTUH
・
Computer scienceEl plan de reclutamiento más ligero y eficaz
Busque currículums y tome la iniciativa de ponerse en contacto con los solicitantes de empleo para lograr una mayor eficacia en la contratación. La elección de cientos de empresas.
- Examinar todos los resultados de la búsqueda
- Acceso ilimitado para iniciar nuevas conversaciones
- currículos accesibles sólo para empresas de pago
- Ver dirección de correo electrónico y números de teléfono de los usuarios
Consejos de búsqueda
1
Search a precise keyword combination
senior backend php
2
Use quotes to search for an exact phrase
"business development"
3
Use the minus sign to eliminate results containing certain words
UI designer -UX
Sólo los currículums públicos están disponibles con el plan gratuito.
Actualiza a un plan avanzado para ver todos los resultados de la búsqueda incluyendo decenas de miles de currículums exclusivos en CakeResume.
Definition of Reputation Credits
Technical Skills
Specialized knowledge and expertise within the profession (e.g. familiar with SEO and use of related tools).
Problem-Solving
Ability to identify, analyze, and prepare solutions to problems.
Adaptability
Ability to navigate unexpected situations; and keep up with shifting priorities, projects, clients, and technology.
Communication
Ability to convey information effectively and is willing to give and receive feedback.
Time Management
Ability to prioritize tasks based on importance; and have them completed within the assigned timeline.
Teamwork
Ability to work cooperatively, communicate effectively, and anticipate each other's demands, resulting in coordinated collective action.
Leadership
Ability to coach, guide, and inspire a team to achieve a shared goal or outcome effectively.
En el plazo de dos meses
Sr. Data Engineer / Team Lead
新加坡商競舞電競娛樂有限公司 Garena Online Private Ltd
・
2021 ~ Presente
Professional Background
Situación actual
Empleado
Progreso en la búsqueda de empleo
Professions
Other
Fields of Employment
Experiencia laboral
6-10 años
Management
I've had experience in managing 1-5 people
Habilidades
Idiomas
Chinese
・
Nativo o bilingüe
English
・
Fluido
Job search preferences
Posición
資料工程師
Tipo de trabajo
A tiempo completo
Ubicación
Taipei, 台灣
A distancia
Interesado en trabajar a distancia
Freelance
Educación
Escuela
Mayor
Yi-Lun Wu (Velen)
Summary
- 7+ years of experience in big data fields both Cloud(GCP, AWS) and on-premised (Cloudera CDH).
- Develop data catalog with hybrid cloud environment(on-perm+AWS) for global commerce at Yahoo.
- Lead a machine learning team to build up offline/real-time platforms for recommendation systems from scratch at Garena.
- Lead and architect large-scale data pipelines/warehouses from Innova Solutions(AWS) and 17LIVE (GCP). And Cooperate with data science/machine learning team/TW HQ data team.
- Expert of Hadoop ecosystems such as HDFS/Hive/Hbase/Spark in Athemaster and Xuenn.
Sr. Big Data Engineer / Team Lead
Taoyuan，TW
[email protected]
Skills
Languages
- Python
- SQL
- Linux Shell Script
- Scala
Big Data Solutions
- Cloudera CDH
- Hadoop echosystems
- AWS EMR
- GCP Dataporc
Data Warehouse
- Hive
- Google BigQuery
- MySQL
- HBase
- Clickhouse
- AWS RDS
- AWS Athena
ETL Skills in Big Data
- Spark / Spark Streaming
- Hive (for ELT)
- Impala
- Kafka
- Cloud DataFlow (GCP)
Workflow Skills
- Airflow
- Digdag
- NiFi
- AWS CloudFormation
Other Skills
- Great communication
- Leaderships
- Scrum
- JIRA
- Linux
- Git
Experience
Senior Engineer at Yahoo．Jan, 2023 - Present
Working at Yahoo. The greatest challenge lies in developing in response to rapid market changes, where the data catalog needs to integrate with various complex systems. Simultaneously, maintaining the highest stability and ensuring high-quality data is essential.
More responsibilities/details as below.
- Fetch providers data with various way via Java. Such as fetching data from client's API, GraphQL, FTP, S3 or GCP... etc.
- standardizing data from above to feed into data warehouse in Hadoop/Hive/HBase using Spark.
- Implement a checking system to guarantee high quality data via Java.
- Migrate part of services from on-perm(Hadoop) to cloud(AWS) to become a hybrid cloud environment.
Senior Data Engineer/ Team Lead, at BOOYAH! Live Garena．Oct, 2021 - Sep, 2022
Working at ML team as a first data engineer. The challenge include build up data warehouse/pipeline from scratch. And design the data flow to support both batch/real-time recommendation systems.
More responsibilities/details as below.
- Design data model from scratch and Manage Hadoop based data warehouse for the training system.
- Develop streaming ETL pipeline via Spark from Message queue(Kafka) into in-memory data structure store(Redis) and ClickHouse for real-time recommendation system.
- Design ELT job for offline report system in Hadoop/Hive using Spark.
- Build up monitoring dashboard on Grafana.
- Take leadership on TW side.
Senior Data Engineer at 17 Media．Jun, 2020 - Oct, 2021
The big challenge of 17 Media data teams is facing fast-growing data volume (processing 5-10x TB level daily), complex cooperation with stakeholders, the cost optimization of pipeline and refactor big latency systems .etc.
More responsibilities/details as below.
- Manage Google BigQuery based data warehouse/lake.
- Refactory architecture of data warehouse to enhance 2x performance.
- Develop batch/streaming ETL pipeline to process data from diverse data sources(e.g. MongoDB, MySQL, APIs) into GCP.
- Design workflow using Digdag.
- Implement CI/CD on BIgQuery.
- Build up visualization tool(Superset) via Kubernetes.
- Well leadership and guiding junior members.
Senior Software Engineer at Innova Solutions Ltd．Oct, 2018 - May, 2020
Development Intelligent Healthcare Data Platform(IHDP) for empowering compony solutions using AWS service.
More responsibilities/details as below.
- Build APIs to the processing of patient records and providing access for downstream usages.
- Build Infrastructure on AWS and compliance for HIPPA and GDPR standard.
IT Consultant at Xuenn Pte Ltd．May, 2018 - Sep, 2018
The biggest challenge in Xuenn is facing performance issues in the original data warehouse. And I lead a project to build up a Hadoop cluster to reduce original EDW loading and improve various data pipelines.
More responsibilities/details as below.
- Perform adopting new technologies to implant into, to fuse into or to replace with existing systems for gaining leaps in performance, benefits and capabilities of the users.
- Building-up multiple systems and integrating with existing system, implemented Hadoop, data mining or data warehouse systems.
- Design an architecture which processing real-time data end-to-end using various Hadoop solutions without coding.
Software Engineer at Athemaster Co., Ltd．Jan, 2016 - Apr, 2018
Athemaster is a technology company offering solutions and expertise in implementing Enterprise Data Hub and automating Data integration with Open Source technologies such as Apache Hadoop and Spark.
More responsibilities/details as below.
- Focus on Enterprise Big Data solution such as Hadoop and Spark (Cloudera CDH).
- Maintain and improved other companies' Hadoop cluster.
- Help other companies integrate with Hadoop and resolved the technical issues.
- Build data pipelines via python ETL data to Hadoop.
Certification and License
CCA-175: CCA Spark and Hadoop Developer
Education
Undergraduate studies at Tamkang University, with a concentration in Department of Management Sciences.
2008 - 2012
Yi-Lun Wu (Velen)
Summary
- 7+ years of experience in big data fields both Cloud(GCP, AWS) and on-premised (Cloudera CDH).
- Develop data catalog with hybrid cloud environment(on-perm+AWS) for global commerce at Yahoo.
- Lead a machine learning team to build up offline/real-time platforms for recommendation systems from scratch at Garena.
- Lead and architect large-scale data pipelines/warehouses from Innova Solutions(AWS) and 17LIVE (GCP). And Cooperate with data science/machine learning team/TW HQ data team.
- Expert of Hadoop ecosystems such as HDFS/Hive/Hbase/Spark in Athemaster and Xuenn.
Sr. Big Data Engineer / Team Lead
Taoyuan，TW
[email protected]
Skills
Languages
- Python
- SQL
- Linux Shell Script
- Scala
Big Data Solutions
- Cloudera CDH
- Hadoop echosystems
- AWS EMR
- GCP Dataporc
Data Warehouse
- Hive
- Google BigQuery
- MySQL
- HBase
- Clickhouse
- AWS RDS
- AWS Athena
ETL Skills in Big Data
- Spark / Spark Streaming
- Hive (for ELT)
- Impala
- Kafka
- Cloud DataFlow (GCP)
Workflow Skills
- Airflow
- Digdag
- NiFi
- AWS CloudFormation
Other Skills
- Great communication
- Leaderships
- Scrum
- JIRA
- Linux
- Git
Experience
Senior Engineer at Yahoo．Jan, 2023 - Present
Working at Yahoo. The greatest challenge lies in developing in response to rapid market changes, where the data catalog needs to integrate with various complex systems. Simultaneously, maintaining the highest stability and ensuring high-quality data is essential.
More responsibilities/details as below.
- Fetch providers data with various way via Java. Such as fetching data from client's API, GraphQL, FTP, S3 or GCP... etc.
- standardizing data from above to feed into data warehouse in Hadoop/Hive/HBase using Spark.
- Implement a checking system to guarantee high quality data via Java.
- Migrate part of services from on-perm(Hadoop) to cloud(AWS) to become a hybrid cloud environment.
Senior Data Engineer/ Team Lead, at BOOYAH! Live Garena．Oct, 2021 - Sep, 2022
Working at ML team as a first data engineer. The challenge include build up data warehouse/pipeline from scratch. And design the data flow to support both batch/real-time recommendation systems.
More responsibilities/details as below.
- Design data model from scratch and Manage Hadoop based data warehouse for the training system.
- Develop streaming ETL pipeline via Spark from Message queue(Kafka) into in-memory data structure store(Redis) and ClickHouse for real-time recommendation system.
- Design ELT job for offline report system in Hadoop/Hive using Spark.
- Build up monitoring dashboard on Grafana.
- Take leadership on TW side.
Senior Data Engineer at 17 Media．Jun, 2020 - Oct, 2021
The big challenge of 17 Media data teams is facing fast-growing data volume (processing 5-10x TB level daily), complex cooperation with stakeholders, the cost optimization of pipeline and refactor big latency systems .etc.
More responsibilities/details as below.
- Manage Google BigQuery based data warehouse/lake.
- Refactory architecture of data warehouse to enhance 2x performance.
- Develop batch/streaming ETL pipeline to process data from diverse data sources(e.g. MongoDB, MySQL, APIs) into GCP.
- Design workflow using Digdag.
- Implement CI/CD on BIgQuery.
- Build up visualization tool(Superset) via Kubernetes.
- Well leadership and guiding junior members.
Senior Software Engineer at Innova Solutions Ltd．Oct, 2018 - May, 2020
Development Intelligent Healthcare Data Platform(IHDP) for empowering compony solutions using AWS service.
More responsibilities/details as below.
- Build APIs to the processing of patient records and providing access for downstream usages.
- Build Infrastructure on AWS and compliance for HIPPA and GDPR standard.
IT Consultant at Xuenn Pte Ltd．May, 2018 - Sep, 2018
The biggest challenge in Xuenn is facing performance issues in the original data warehouse. And I lead a project to build up a Hadoop cluster to reduce original EDW loading and improve various data pipelines.
More responsibilities/details as below.
- Perform adopting new technologies to implant into, to fuse into or to replace with existing systems for gaining leaps in performance, benefits and capabilities of the users.
- Building-up multiple systems and integrating with existing system, implemented Hadoop, data mining or data warehouse systems.
- Design an architecture which processing real-time data end-to-end using various Hadoop solutions without coding.
Software Engineer at Athemaster Co., Ltd．Jan, 2016 - Apr, 2018
Athemaster is a technology company offering solutions and expertise in implementing Enterprise Data Hub and automating Data integration with Open Source technologies such as Apache Hadoop and Spark.
More responsibilities/details as below.
- Focus on Enterprise Big Data solution such as Hadoop and Spark (Cloudera CDH).
- Maintain and improved other companies' Hadoop cluster.
- Help other companies integrate with Hadoop and resolved the technical issues.
- Build data pipelines via python ETL data to Hadoop.
Certification and License
CCA-175: CCA Spark and Hadoop Developer
Education
Undergraduate studies at Tamkang University, with a concentration in Department of Management Sciences.
2008 - 2012