CakeResume Talent Search

Advanced filters
On
4-6 tahun
6-10 tahun
10-15 tahun
Lebih dari 15 tahun
Avatar of Yen-Ting Liu.
Avatar of Yen-Ting Liu.
Data Engineer @Tesla
2023 ~ 2023
Data engineer / Data anyayst
Dalam dua bulan
data that included geo-location data from BigQuery and deployed it on the GCP environment. The API saved 80% of the time on fetching data (Cloud Run, IAM, BigQuery) 十月七月 2021 Data engineer • 富盈數據 Maintained distributed system and database • Constructed and managed the Hadoop ecosystem with Ambari. Built ETL pipeline to query multi-source database which processing more than three terabytes (TB) provided 90% of the analysis needs (Hive, HBase, Python, ELK, MySQL) • Established data collection and analysis workflow, saving Data scientists’ 30% of the time to analyze and build machine learning
python
Linux
R
Sudah bekerja
Siap untuk wawancara
Full-time / Tertarik bekerja jarak jauh
4-6 tahun
University of Texas at Dallas
Information Technology and Management
Avatar of Chin-Hung (Wilson) Liu.
Avatar of Chin-Hung (Wilson) Liu.
Principal Engineer, Data Engineering @KKCompany
2023 ~ Sekarang
Backend Engineer, Data Engineer, MLOps Engineer
Dalam satu bulan
Chin-Hung (Wilson) Liu I am a lead architect responsible for designing and implementing a large-scale data pipeline for Lomotif, Paktor x 17LIVE, utilizing GCP/AWS/Python/Scala, in collaboration with data science and machine learning teams in Singapore and TW HQ, as well as with the Hadoop ecosystem (HDFS/HBase/Kafka) at JSpectrum in Hong Kong and Sydney. With over 15 years of experience in designing and developing Java/Scala/Python-based applications for daily operations, I bring: ● At least 8 years of experience in data analysis, pipeline design
Big Data
Data Engineering
ETL
Sudah bekerja
Terbuka untuk peluang
Full-time / Tertarik bekerja jarak jauh
10-15 tahun
National Taiwan University
EMBA Programs, Business Administration, Accounting, Finance and International Business.
Avatar of 陳柄宏.
Avatar of 陳柄宏.
Staff Cloud Architect Enginner @域動行銷股份有限公司
2023 ~ Sekarang
雲端工程師,雲端架構師,數據架構師
Dalam satu bulan
及進步的團隊。 [email protected], Taiwan Education 輔仁大學圖書資訊學系,Skills Python 程式寫作、實作爬蟲及資料清理作業。 Database SQL : PostgreSQL, MySQL, MSSQL NoSQL: MongoDB, Redis, DynamoDB, Hadoop Docker 容器化技術 Data Lakehouse Databricks Azure 持有Microsoft Certified: Azure Solutions Architect Expert 及 Data enginner 證照 AWS 持有 AWS Certified Solutions Architect – Professional 證照 工作經歷 Staff Cloud Architect Enginner , 域動行銷股份有限
git
hadoop ecosystem
MongoDB
Sudah bekerja
Tidak terbuka untuk peluang
Full-time / Tertarik bekerja jarak jauh
4-6 tahun
輔仁大學
圖書資訊
Avatar of the user.
Avatar of the user.
Team Lead / Sr. Data Engineer @新加坡商競舞電競娛樂有限公司 Garena Online Private Ltd
2021 ~ Sekarang
資料工程師
Dalam satu bulan
Hadoop
Spark
SQL
Sudah bekerja
Full-time / Tertarik bekerja jarak jauh
6-10 tahun
Avatar of Carter Lin.
Avatar of Carter Lin.
Senior Data Engineer @美光科技
2021 ~ Sekarang
Software Engineer / Backend Engineer / DevOps Engineer
Dalam enam bulan
CD pipelines from scratch which follow GitOps flow and deploying service to GKE cluster using Helm . Familiar with GCP service , IAM, GCS, Big Query, Cloud Function, Pub/Sub, Cloud Scheduler Data Engineer Micron OctOct 2021 Taichung, Taiwan Developed and maintained ETL processes using Python to transfer data into Hadoop Ecosystem, including HBase and Hive, for efficient data storage and retrieval. Proficient in SQL for data manipulation and query optimization. Collaborated with cross-functional teams to design and implement data pipelines, ensuring data integrity and accuracy. Streamlined data processing workflows, resulting in significant time and resource
Python
Google cloud platform
Helm
Sudah bekerja
Full-time / Hanya bekerja jarak jauh
4-6 tahun
National Chiao Tung University
資訊管理學系
Avatar of Aiden Wu.
Avatar of Aiden Wu.
Senior Data Engineer @Garena
2021 ~ Sekarang
Data engineer
Dalam satu tahun
Aiden Wu Data Engineer / Machine Learning Engineer Taipei, Taiwan • Enthusiastic software developer: focus on distributed systems, especially Hadoop ecosystem • Experience in data engineering: develop batch and real-time data pipelines with an average of TBs per month via Spark and Airflow • Experience in machine learning: develop machine learning (ML) and deep learning (DL) models while providing services on RESTful API https://www.slideshare.net/ssuserf88631/presentations 工作經歷 Senior Data Engineer • Garena 八月Present • Build and manage self-distributed systems (e.g., Hadoop, Spark, and Kafka Cluster) • Design
Python
Spark
Machine Learning
Sudah bekerja
Full-time / Tertarik bekerja jarak jauh
4-6 tahun
National Cheng Kung University
Department of Electrical Engineering
Avatar of 陳慶全.
Avatar of 陳慶全.
Senior Data Engineer @Microsoft
2021 ~ Sekarang
資料科學家、資料工程師、資料分析師
Dalam satu bulan
Ching-Chuan Chen 陳慶全 資料科學家、資料工程師、資料分析師 • City, TW • [email protected] Data engineer and data scientist with over four half years of experience. Proven success in processing big volume of data (6TB per day) in Spark in Scala and MPI in R and Python, developing a machine learning model with Spark in Scala on 30 billions of records for IoT device recognition and developing algorithms to classify unlabeled network behaviors of customers to protect their devices from compromising. Skilled in programming
R
Python
C++
Sudah bekerja
Full-time / Tertarik bekerja jarak jauh
4-6 tahun
National Cheng Kung University,
Statistics
Avatar of the user.
Dalam satu tahun
Python
Bigdata
Docker
Sudah bekerja
Full-time / Tertarik bekerja jarak jauh
10-15 tahun
Avatar of the user.
Avatar of the user.
Jr. Programmer @德義資訊股份有限公司
2013 ~ 2015
Developer Team Leader, Architect, FullStack Developer
Lebih dari satu tahun
Word
PowerPoint
Excel
Sudah bekerja
Full-time / Tertarik bekerja jarak jauh
6-10 tahun
National Taiwan University
Bachelor of Bio-Industrial Mechatronics Engineering
Avatar of Mallikarjunareddy Guruguntla.
Big data developer
Lebih dari satu tahun
ZOOKEEPER. Summary Excellent understanding /knowledge on HADOOP(Gen-1 and Gen-2) and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, Resource Manager (YARN), Node Manager and Aplication Master. Expert in understanding the data and designing/implementing the enterprise platforms like Hadoop data lake and huge Data warehouses. Have over 2 years of experience as Hadoop Architect with very good exposure on Hadoop Technologies like HDFS, YARN, MapReduce, Sqoop, Flume, HBase, Hive, Presto, Oozie and Spark. Good understanding of NoSQL databases and hands on working experience in writing applications
hadoop ecosystem
Python
Scala
Full-time / Tertarik bekerja jarak jauh
6-10 tahun
JNTUH
Computer science

Paket Perekrutan Paling Mudah dan Efektif, Pilihan Ratusan Perusahaan

Cari lebih dari 800 ribu CV dan ambil aksi menghubungi pelamar kerja untuk rekrutmen yang lebih efektif. Pilihan ratusan perusahaan.

  • Lihat semua hasil pencarian
  • Tanpa batas harian untuk memulai pesan baru
  • CV dapat diakses oleh perusahaan berbayar
  • Lihat email pengguna & nomor telepon
Tips pencarian
1
Search a precise keyword combination
senior backend php
If the number of the search result is not enough, you can remove the less important keywords
2
Use quotes to search for an exact phrase
"business development"
3
Use the minus sign to eliminate results containing certain words
UI designer -UX
Hanya CV publik yang tersedia dengan paket gratis.
Upgrade ke paket lanjutan untuk melihat semua hasil pencarian, termasuk 10.000 lebih CV eksklusif di Cake Resume.

Definition of Reputation Credits

Technical Skills
Specialized knowledge and expertise within the profession (e.g. familiar with SEO and use of related tools).
Problem-Solving
Ability to identify, analyze, and prepare solutions to problems.
Adaptability
Ability to navigate unexpected situations; and keep up with shifting priorities, projects, clients, and technology.
Communication
Ability to convey information effectively and is willing to give and receive feedback.
Time Management
Ability to prioritize tasks based on importance; and have them completed within the assigned timeline.
Teamwork
Ability to work cooperatively, communicate effectively, and anticipate each other's demands, resulting in coordinated collective action.
Leadership
Ability to coach, guide, and inspire a team to achieve a shared goal or outcome effectively.
Dalam satu bulan
雲端資料工程師
Logo of 域動行銷股份有限公司.
域動行銷股份有限公司
2023 ~ Sekarang
台灣新北市
Latar Belakang Profesional
Status sekarang
Sudah bekerja
Tahap pencarian kerja
Tidak terbuka untuk peluang
Profesi
Data Engineer, Big Data Engineer, System Architecture
Bidang Pekerjaan
Intelegensi Artifisial/Pemelajaran Mesin, Big Data
Pengalaman Kerja
Lebih dari 15 tahun pengalaman kerja (4-6 tahun relevan)
Management
Saya berpengalaman mengelola 15+ orang
Keterampilan
git
hadoop ecosystem
MongoDB
MySQL
django
Flask(Python)
AWS
django rest framework
PostgreSQL
Python
Azure
Bahasa
English
Menengah
Preferensi Pencarian Pekerjaan
Jabatan
雲端工程師,雲端架構師,數據架構師
Tipe Pekerjaan
Full-time
Lokasi
台灣台北市
Bekerja jarak jauh
Tertarik bekerja jarak jauh
Freelance
Tidak
Pendidikan
Institusi Pendidikan
輔仁大學
Jurusan
圖書資訊
Cetak

CHEN, PING-HUNG

       陳    柄   宏

Cloud Data Engineer

  New Taipei City, Taiwan

I hold certifications for both AWS and Azure platforms, and have been continuously deepening my knowledge in cloud computing. I am skilled in using Python programming language for data science-related tasks and automation operations. I have participated in big data projects such as smart transportation and real estate prediction, and I aspire to not only leverage my current skillset but also to be part of a team that encourages learning and growth for future development.

    

(886) 0958175322

[email protected]

Skills

Python

Program writing, implementation of crawlers and data cleaning operations.

MongoDB

Ability to build and maintain a distributed storage system, complete the implementation of Replica and Sharding architecture, be familiar with the use of Mongo shell, and write server-side javascript.

MySQL

Familiar with MySQL database usage, model design, SQL syntax optimization.

PostgreSQL

Familiar with PostgreSQL database usage, model design, SQL syntax optimization.

Pandas

Familiar with Pandas ETL operations and data visualization.

Git

Familiar with using Git to manage code version control. with using Git to manage code version control.

Spark

Familiar with Pyspark ETL operations.

Azure

Hold Azure Administrator Associate and Data Enginner license

AWS

Hold AWS Certified Solutions Architect – Associate license.

Education

2003 - 2007

Fu Jen Catholic University

Department of Library and Information Science

2016 - 2017

BigData Analyst Class(AB106)

coding bootcamp(Institute for Information Industry)

Experience

Feb 2023 - Apr 2023

Solutions Architect

CKmates

Responsible for AWS cloud architecture  and solution design.

Apr 2022 - Jan 2023

Cloud Data Engineer

SinYi Realty Inc.

Responsible for Azure cloud architecture  and Data  ETL Pipeline development and management.

Jan 2019 - Apr 2022

Backend Engineer

AnFu Solutions Inc.

Responsible for AWS cloud environment management and architecture, ETL data cleaning, and Python API development.

Project experience:

  1. House+:
    • Data cleaning process management, using Elastic Beanstalk in the AWS cloud environment to establish a data cleaning process pipeline.
    • Model training process management, using Elastic Beanstalk in the AWS cloud environment to establish a model training process pipeline.
    • Web crawler writing, writing web crawlers, collecting public information on the Internet, as supplementary data for model training.
  2. AWS cloud environment management and architecture:
    • Architect and optimize the AWS cloud environment, reconstruct VPC, reduce usage costs, and improve security.
    • Assist the company to obtain ISO 27001 information security international certification.
    • Use work experience and self-study to obtain AWS SAA Architect certification.
    • Invited to be the corporate speaker of the AWS Taipei Summit 2021.
  3. Government projects:
    • Taipei City Road Rate Website Development Project, responsible for overall website reconstruction and optimization.
    • New Taipei City automated valuation website development project, responsible for overall website development and maintenance.
    • Ministry of the Interior Periodic Housing Price Index Case, responsible for data ETL operations
    • Taipei city cadastral data research case, responsible for data ETL operations.
    • Tainan city cadastral data research case, responsible for data ETL operations.
    • New Taipei City cadastral data research case, responsible for data ETL operations.

Jul 2018 - Jan 2019

Data Engineer

InfiArk Inc.

Responsible for MongoDB massive data storage architecture and construction, AWS and Azure cloud platform management operations, backend API writing (Python Flask), and overall planning and architecture of the project system.

Project experience:

  1. The Taipei City Government’s transportation demonstration project :
    • Responsible for the construction of the data storage system of the forecasting system, and establish a fast response and stable system with MongoDB (Sharding) and MySQL (AWS).
  2. Car navigation system optimization case:
    • Data ETL operation (average 30 memos per month), a total of about 3Tib data volume per year, after the data is cleaned up, put it into the MongoDB cluster, implement 7 data partitions in the sharding way, to ensure that the data access response time can be 0.03 -Complete within 0.05 seconds.
    • Car speed real-time data prediction and timely data interface, design and complete the overall process of output prediction after the vehicle speed and real-time data interface (use the first 2 hours of data to predict, 15 minutes after the prediction, response time 1 minute)
    • Responsible for the establishment of all related services in Azure and AWS cloud. This project is built in Azure services.
    • Design and build a real-time data forecasting system for vehicle speed, and take the lead from the use of tools to platform architecture, the use of cloud service machine specifications, overall data growth estimation, forecasting process and resource evaluation.
  3. Medical disease prediction case:
    • Disease prediction API writing, users can input health check data through this API, and real-time query disease incidence rates online.
    • Use Nginx + Uwsgi to build API Server.

Jun 2017 - Nov 2017

Data Engineer

Blue Technology Inc.

Responsible for Python programming, MongoDB cluster database construction and maintenance, Spark computing cluster construction and development.
Project experience:
1. Concept verification of MongoDB and Spark big data analysis platform architecture

Jul 2007 - Dec 2016

Professional soldier

CGA

Served as a judicial police officer in the CGA, responsible for shore and sea patrols and investigations.

Certification

CV
Profil

CHEN, PING-HUNG

       陳    柄   宏

Cloud Data Engineer

  New Taipei City, Taiwan

I hold certifications for both AWS and Azure platforms, and have been continuously deepening my knowledge in cloud computing. I am skilled in using Python programming language for data science-related tasks and automation operations. I have participated in big data projects such as smart transportation and real estate prediction, and I aspire to not only leverage my current skillset but also to be part of a team that encourages learning and growth for future development.

    

(886) 0958175322

[email protected]

Skills

Python

Program writing, implementation of crawlers and data cleaning operations.

MongoDB

Ability to build and maintain a distributed storage system, complete the implementation of Replica and Sharding architecture, be familiar with the use of Mongo shell, and write server-side javascript.

MySQL

Familiar with MySQL database usage, model design, SQL syntax optimization.

PostgreSQL

Familiar with PostgreSQL database usage, model design, SQL syntax optimization.

Pandas

Familiar with Pandas ETL operations and data visualization.

Git

Familiar with using Git to manage code version control. with using Git to manage code version control.

Spark

Familiar with Pyspark ETL operations.

Azure

Hold Azure Administrator Associate and Data Enginner license

AWS

Hold AWS Certified Solutions Architect – Associate license.

Education

2003 - 2007

Fu Jen Catholic University

Department of Library and Information Science

2016 - 2017

BigData Analyst Class(AB106)

coding bootcamp(Institute for Information Industry)

Experience

Feb 2023 - Apr 2023

Solutions Architect

CKmates

Responsible for AWS cloud architecture  and solution design.

Apr 2022 - Jan 2023

Cloud Data Engineer

SinYi Realty Inc.

Responsible for Azure cloud architecture  and Data  ETL Pipeline development and management.

Jan 2019 - Apr 2022

Backend Engineer

AnFu Solutions Inc.

Responsible for AWS cloud environment management and architecture, ETL data cleaning, and Python API development.

Project experience:

  1. House+:
    • Data cleaning process management, using Elastic Beanstalk in the AWS cloud environment to establish a data cleaning process pipeline.
    • Model training process management, using Elastic Beanstalk in the AWS cloud environment to establish a model training process pipeline.
    • Web crawler writing, writing web crawlers, collecting public information on the Internet, as supplementary data for model training.
  2. AWS cloud environment management and architecture:
    • Architect and optimize the AWS cloud environment, reconstruct VPC, reduce usage costs, and improve security.
    • Assist the company to obtain ISO 27001 information security international certification.
    • Use work experience and self-study to obtain AWS SAA Architect certification.
    • Invited to be the corporate speaker of the AWS Taipei Summit 2021.
  3. Government projects:
    • Taipei City Road Rate Website Development Project, responsible for overall website reconstruction and optimization.
    • New Taipei City automated valuation website development project, responsible for overall website development and maintenance.
    • Ministry of the Interior Periodic Housing Price Index Case, responsible for data ETL operations
    • Taipei city cadastral data research case, responsible for data ETL operations.
    • Tainan city cadastral data research case, responsible for data ETL operations.
    • New Taipei City cadastral data research case, responsible for data ETL operations.

Jul 2018 - Jan 2019

Data Engineer

InfiArk Inc.

Responsible for MongoDB massive data storage architecture and construction, AWS and Azure cloud platform management operations, backend API writing (Python Flask), and overall planning and architecture of the project system.

Project experience:

  1. The Taipei City Government’s transportation demonstration project :
    • Responsible for the construction of the data storage system of the forecasting system, and establish a fast response and stable system with MongoDB (Sharding) and MySQL (AWS).
  2. Car navigation system optimization case:
    • Data ETL operation (average 30 memos per month), a total of about 3Tib data volume per year, after the data is cleaned up, put it into the MongoDB cluster, implement 7 data partitions in the sharding way, to ensure that the data access response time can be 0.03 -Complete within 0.05 seconds.
    • Car speed real-time data prediction and timely data interface, design and complete the overall process of output prediction after the vehicle speed and real-time data interface (use the first 2 hours of data to predict, 15 minutes after the prediction, response time 1 minute)
    • Responsible for the establishment of all related services in Azure and AWS cloud. This project is built in Azure services.
    • Design and build a real-time data forecasting system for vehicle speed, and take the lead from the use of tools to platform architecture, the use of cloud service machine specifications, overall data growth estimation, forecasting process and resource evaluation.
  3. Medical disease prediction case:
    • Disease prediction API writing, users can input health check data through this API, and real-time query disease incidence rates online.
    • Use Nginx + Uwsgi to build API Server.

Jun 2017 - Nov 2017

Data Engineer

Blue Technology Inc.

Responsible for Python programming, MongoDB cluster database construction and maintenance, Spark computing cluster construction and development.
Project experience:
1. Concept verification of MongoDB and Spark big data analysis platform architecture

Jul 2007 - Dec 2016

Professional soldier

CGA

Served as a judicial police officer in the CGA, responsible for shore and sea patrols and investigations.

Certification