CakeResume Talent Search

上級
On
4〜6年
6〜10年
10〜15年
15年以上
Avatar of Yen-Ting Liu.
Avatar of Yen-Ting Liu.
Data Engineer @Tesla
2023 ~ 2023
Data engineer / Data anyayst
2ヶ月以内
data that included geo-location data from BigQuery and deployed it on the GCP environment. The API saved 80% of the time on fetching data (Cloud Run, IAM, BigQuery) 十月七月 2021 Data engineer • 富盈數據 Maintained distributed system and database • Constructed and managed the Hadoop ecosystem with Ambari. Built ETL pipeline to query multi-source database which processing more than three terabytes (TB) provided 90% of the analysis needs (Hive, HBase, Python, ELK, MySQL) • Established data collection and analysis workflow, saving Data scientists’ 30% of the time to analyze and build machine learning
python
Linux
R
就職中
面接の用意ができています
フルタイム / リモートワークに興味あり
4〜6年
University of Texas at Dallas
Information Technology and Management
Avatar of Chin-Hung (Wilson) Liu.
Avatar of Chin-Hung (Wilson) Liu.
Principal Engineer, Data Engineering @KKCompany
2023 ~ 現在
Backend Engineer, Data Engineer, MLOps Engineer
1ヶ月以内
Chin-Hung (Wilson) Liu I am a lead architect responsible for designing and implementing a large-scale data pipeline for Lomotif, Paktor x 17LIVE, utilizing GCP/AWS/Python/Scala, in collaboration with data science and machine learning teams in Singapore and TW HQ, as well as with the Hadoop ecosystem (HDFS/HBase/Kafka) at JSpectrum in Hong Kong and Sydney. With over 15 years of experience in designing and developing Java/Scala/Python-based applications for daily operations, I bring: ● At least 8 years of experience in data analysis, pipeline design
Big Data
Data Engineering
ETL
就職中
就職希望
フルタイム / リモートワークに興味あり
10〜15年
National Taiwan University
EMBA Programs, Business Administration, Accounting, Finance and International Business.
Avatar of 陳柄宏.
Avatar of 陳柄宏.
Staff Cloud Architect Enginner @域動行銷股份有限公司
2023 ~ 現在
雲端工程師,雲端架構師,數據架構師
1ヶ月以内
及進步的團隊。 [email protected], Taiwan Education 輔仁大學圖書資訊學系,Skills Python 程式寫作、實作爬蟲及資料清理作業。 Database SQL : PostgreSQL, MySQL, MSSQL NoSQL: MongoDB, Redis, DynamoDB, Hadoop Docker 容器化技術 Data Lakehouse Databricks Azure 持有Microsoft Certified: Azure Solutions Architect Expert 及 Data enginner 證照 AWS 持有 AWS Certified Solutions Architect – Professional 證照 工作經歷 Staff Cloud Architect Enginner , 域動行銷股份有限
git
hadoop ecosystem
MongoDB
就職中
就職を希望していません
フルタイム / リモートワークに興味あり
4〜6年
輔仁大學
圖書資訊
Avatar of the user.
Avatar of the user.
Team Lead / Sr. Data Engineer @新加坡商競舞電競娛樂有限公司 Garena Online Private Ltd
2021 ~ 現在
資料工程師
1ヶ月以内
Hadoop
Spark
SQL
就職中
フルタイム / リモートワークに興味あり
6〜10年
Avatar of Carter Lin.
Avatar of Carter Lin.
Senior Data Engineer @美光科技
2021 ~ 現在
Software Engineer / Backend Engineer / DevOps Engineer
6ヶ月以内
CD pipelines from scratch which follow GitOps flow and deploying service to GKE cluster using Helm . Familiar with GCP service , IAM, GCS, Big Query, Cloud Function, Pub/Sub, Cloud Scheduler Data Engineer Micron OctOct 2021 Taichung, Taiwan Developed and maintained ETL processes using Python to transfer data into Hadoop Ecosystem, including HBase and Hive, for efficient data storage and retrieval. Proficient in SQL for data manipulation and query optimization. Collaborated with cross-functional teams to design and implement data pipelines, ensuring data integrity and accuracy. Streamlined data processing workflows, resulting in significant time and resource
Python
Google cloud platform
Helm
就職中
フルタイム / リモートワークのみ
4〜6年
National Chiao Tung University
資訊管理學系
Avatar of Aiden Wu.
Avatar of Aiden Wu.
Senior Data Engineer @Garena
2021 ~ 現在
Data engineer
1年以内
Aiden Wu Data Engineer / Machine Learning Engineer Taipei, Taiwan • Enthusiastic software developer: focus on distributed systems, especially Hadoop ecosystem • Experience in data engineering: develop batch and real-time data pipelines with an average of TBs per month via Spark and Airflow • Experience in machine learning: develop machine learning (ML) and deep learning (DL) models while providing services on RESTful API https://www.slideshare.net/ssuserf88631/presentations 工作經歷 Senior Data Engineer • Garena 八月Present • Build and manage self-distributed systems (e.g., Hadoop, Spark, and Kafka Cluster) • Design
Python
Spark
Machine Learning
就職中
フルタイム / リモートワークに興味あり
4〜6年
National Cheng Kung University
Department of Electrical Engineering
Avatar of 陳慶全.
Avatar of 陳慶全.
Senior Data Engineer @Microsoft
2021 ~ 現在
資料科學家、資料工程師、資料分析師
1ヶ月以内
Ching-Chuan Chen 陳慶全 資料科學家、資料工程師、資料分析師 • City, TW • [email protected] Data engineer and data scientist with over four half years of experience. Proven success in processing big volume of data (6TB per day) in Spark in Scala and MPI in R and Python, developing a machine learning model with Spark in Scala on 30 billions of records for IoT device recognition and developing algorithms to classify unlabeled network behaviors of customers to protect their devices from compromising. Skilled in programming
R
Python
C++
就職中
フルタイム / リモートワークに興味あり
4〜6年
National Cheng Kung University,
Statistics
Avatar of the user.
1年以内
Python
Bigdata
Docker
就職中
フルタイム / リモートワークに興味あり
10〜15年
Avatar of the user.
Avatar of the user.
Jr. Programmer @德義資訊股份有限公司
2013 ~ 2015
Developer Team Leader, Architect, FullStack Developer
1年以上
Word
PowerPoint
Excel
就職中
フルタイム / リモートワークに興味あり
6〜10年
National Taiwan University
Bachelor of Bio-Industrial Mechatronics Engineering
Avatar of Mallikarjunareddy Guruguntla.
Big data developer
1年以上
ZOOKEEPER. Summary Excellent understanding /knowledge on HADOOP(Gen-1 and Gen-2) and various components such as HDFS, Job Tracker, Task Tracker, Name Node, Data Node, Resource Manager (YARN), Node Manager and Aplication Master. Expert in understanding the data and designing/implementing the enterprise platforms like Hadoop data lake and huge Data warehouses. Have over 2 years of experience as Hadoop Architect with very good exposure on Hadoop Technologies like HDFS, YARN, MapReduce, Sqoop, Flume, HBase, Hive, Presto, Oozie and Spark. Good understanding of NoSQL databases and hands on working experience in writing applications
hadoop ecosystem
Python
Scala
フルタイム / リモートワークに興味あり
6〜10年
JNTUH
Computer science

最も簡単で効果的な採用プラン

80万枚以上の履歴書を検索して、率先して求人応募者と連絡をとって採用効率を高めましょう。何百もの企業に選ばれています。

  • 検索結果をすべて閲覧
  • 新しい会話を無制限に始められます
  • 有料企業にのみ履歴書を公開
  • ユーザーのメールアドレスと電話番号を確認
検索のコツ
1
Search a precise keyword combination
senior backend php
If the number of the search result is not enough, you can remove the less important keywords
2
Use quotes to search for an exact phrase
"business development"
3
Use the minus sign to eliminate results containing certain words
UI designer -UX
無料プランでは公開済みの履歴書のみ利用できます。
上級プランにアップグレードして、CakeResume限定の何百万の履歴書など、すべての検索結果を閲覧しましょう。

Definition of Reputation Credits

Technical Skills
Specialized knowledge and expertise within the profession (e.g. familiar with SEO and use of related tools).
Problem-Solving
Ability to identify, analyze, and prepare solutions to problems.
Adaptability
Ability to navigate unexpected situations; and keep up with shifting priorities, projects, clients, and technology.
Communication
Ability to convey information effectively and is willing to give and receive feedback.
Time Management
Ability to prioritize tasks based on importance; and have them completed within the assigned timeline.
Teamwork
Ability to work cooperatively, communicate effectively, and anticipate each other's demands, resulting in coordinated collective action.
Leadership
Ability to coach, guide, and inspire a team to achieve a shared goal or outcome effectively.
1ヶ月以内
雲端資料工程師
Logo of 域動行銷股份有限公司.
域動行銷股份有限公司
2023 ~ 現在
台灣新北市
Professional Background
現在の状況
就職中
求人検索の進捗
就職を希望していません
Professions
Data Engineer, Big Data Engineer, System Architecture
Fields of Employment
人工知能/機械学習, ビッグデータ
職務経験
15年以上の職務経験(4〜6年関連)
Management
I've had experience in managing 15+ people
スキル
git
hadoop ecosystem
MongoDB
MySQL
django
Flask(Python)
AWS
django rest framework
PostgreSQL
Python
Azure
言語
English
中級者
Job search preferences
希望のポジション
雲端工程師,雲端架構師,數據架構師
求人タイプ
フルタイム
希望の勤務地
台灣台北市
リモートワーク
リモートワークに興味あり
Freelance
いいえ。
学歴
学校
輔仁大學
専攻
圖書資訊
印刷

CHEN, PING-HUNG

       陳    柄   宏

Cloud Data Engineer

  New Taipei City, Taiwan

I hold certifications for both AWS and Azure platforms, and have been continuously deepening my knowledge in cloud computing. I am skilled in using Python programming language for data science-related tasks and automation operations. I have participated in big data projects such as smart transportation and real estate prediction, and I aspire to not only leverage my current skillset but also to be part of a team that encourages learning and growth for future development.

    

(886) 0958175322

[email protected]

Skills

Python

Program writing, implementation of crawlers and data cleaning operations.

MongoDB

Ability to build and maintain a distributed storage system, complete the implementation of Replica and Sharding architecture, be familiar with the use of Mongo shell, and write server-side javascript.

MySQL

Familiar with MySQL database usage, model design, SQL syntax optimization.

PostgreSQL

Familiar with PostgreSQL database usage, model design, SQL syntax optimization.

Pandas

Familiar with Pandas ETL operations and data visualization.

Git

Familiar with using Git to manage code version control. with using Git to manage code version control.

Spark

Familiar with Pyspark ETL operations.

Azure

Hold Azure Administrator Associate and Data Enginner license

AWS

Hold AWS Certified Solutions Architect – Associate license.

Education

2003 - 2007

Fu Jen Catholic University

Department of Library and Information Science

2016 - 2017

BigData Analyst Class(AB106)

coding bootcamp(Institute for Information Industry)

Experience

Feb 2023 - Apr 2023

Solutions Architect

CKmates

Responsible for AWS cloud architecture  and solution design.

Apr 2022 - Jan 2023

Cloud Data Engineer

SinYi Realty Inc.

Responsible for Azure cloud architecture  and Data  ETL Pipeline development and management.

Jan 2019 - Apr 2022

Backend Engineer

AnFu Solutions Inc.

Responsible for AWS cloud environment management and architecture, ETL data cleaning, and Python API development.

Project experience:

  1. House+:
    • Data cleaning process management, using Elastic Beanstalk in the AWS cloud environment to establish a data cleaning process pipeline.
    • Model training process management, using Elastic Beanstalk in the AWS cloud environment to establish a model training process pipeline.
    • Web crawler writing, writing web crawlers, collecting public information on the Internet, as supplementary data for model training.
  2. AWS cloud environment management and architecture:
    • Architect and optimize the AWS cloud environment, reconstruct VPC, reduce usage costs, and improve security.
    • Assist the company to obtain ISO 27001 information security international certification.
    • Use work experience and self-study to obtain AWS SAA Architect certification.
    • Invited to be the corporate speaker of the AWS Taipei Summit 2021.
  3. Government projects:
    • Taipei City Road Rate Website Development Project, responsible for overall website reconstruction and optimization.
    • New Taipei City automated valuation website development project, responsible for overall website development and maintenance.
    • Ministry of the Interior Periodic Housing Price Index Case, responsible for data ETL operations
    • Taipei city cadastral data research case, responsible for data ETL operations.
    • Tainan city cadastral data research case, responsible for data ETL operations.
    • New Taipei City cadastral data research case, responsible for data ETL operations.

Jul 2018 - Jan 2019

Data Engineer

InfiArk Inc.

Responsible for MongoDB massive data storage architecture and construction, AWS and Azure cloud platform management operations, backend API writing (Python Flask), and overall planning and architecture of the project system.

Project experience:

  1. The Taipei City Government’s transportation demonstration project :
    • Responsible for the construction of the data storage system of the forecasting system, and establish a fast response and stable system with MongoDB (Sharding) and MySQL (AWS).
  2. Car navigation system optimization case:
    • Data ETL operation (average 30 memos per month), a total of about 3Tib data volume per year, after the data is cleaned up, put it into the MongoDB cluster, implement 7 data partitions in the sharding way, to ensure that the data access response time can be 0.03 -Complete within 0.05 seconds.
    • Car speed real-time data prediction and timely data interface, design and complete the overall process of output prediction after the vehicle speed and real-time data interface (use the first 2 hours of data to predict, 15 minutes after the prediction, response time 1 minute)
    • Responsible for the establishment of all related services in Azure and AWS cloud. This project is built in Azure services.
    • Design and build a real-time data forecasting system for vehicle speed, and take the lead from the use of tools to platform architecture, the use of cloud service machine specifications, overall data growth estimation, forecasting process and resource evaluation.
  3. Medical disease prediction case:
    • Disease prediction API writing, users can input health check data through this API, and real-time query disease incidence rates online.
    • Use Nginx + Uwsgi to build API Server.

Jun 2017 - Nov 2017

Data Engineer

Blue Technology Inc.

Responsible for Python programming, MongoDB cluster database construction and maintenance, Spark computing cluster construction and development.
Project experience:
1. Concept verification of MongoDB and Spark big data analysis platform architecture

Jul 2007 - Dec 2016

Professional soldier

CGA

Served as a judicial police officer in the CGA, responsible for shore and sea patrols and investigations.

Certification

Resume
プロフィール

CHEN, PING-HUNG

       陳    柄   宏

Cloud Data Engineer

  New Taipei City, Taiwan

I hold certifications for both AWS and Azure platforms, and have been continuously deepening my knowledge in cloud computing. I am skilled in using Python programming language for data science-related tasks and automation operations. I have participated in big data projects such as smart transportation and real estate prediction, and I aspire to not only leverage my current skillset but also to be part of a team that encourages learning and growth for future development.

    

(886) 0958175322

[email protected]

Skills

Python

Program writing, implementation of crawlers and data cleaning operations.

MongoDB

Ability to build and maintain a distributed storage system, complete the implementation of Replica and Sharding architecture, be familiar with the use of Mongo shell, and write server-side javascript.

MySQL

Familiar with MySQL database usage, model design, SQL syntax optimization.

PostgreSQL

Familiar with PostgreSQL database usage, model design, SQL syntax optimization.

Pandas

Familiar with Pandas ETL operations and data visualization.

Git

Familiar with using Git to manage code version control. with using Git to manage code version control.

Spark

Familiar with Pyspark ETL operations.

Azure

Hold Azure Administrator Associate and Data Enginner license

AWS

Hold AWS Certified Solutions Architect – Associate license.

Education

2003 - 2007

Fu Jen Catholic University

Department of Library and Information Science

2016 - 2017

BigData Analyst Class(AB106)

coding bootcamp(Institute for Information Industry)

Experience

Feb 2023 - Apr 2023

Solutions Architect

CKmates

Responsible for AWS cloud architecture  and solution design.

Apr 2022 - Jan 2023

Cloud Data Engineer

SinYi Realty Inc.

Responsible for Azure cloud architecture  and Data  ETL Pipeline development and management.

Jan 2019 - Apr 2022

Backend Engineer

AnFu Solutions Inc.

Responsible for AWS cloud environment management and architecture, ETL data cleaning, and Python API development.

Project experience:

  1. House+:
    • Data cleaning process management, using Elastic Beanstalk in the AWS cloud environment to establish a data cleaning process pipeline.
    • Model training process management, using Elastic Beanstalk in the AWS cloud environment to establish a model training process pipeline.
    • Web crawler writing, writing web crawlers, collecting public information on the Internet, as supplementary data for model training.
  2. AWS cloud environment management and architecture:
    • Architect and optimize the AWS cloud environment, reconstruct VPC, reduce usage costs, and improve security.
    • Assist the company to obtain ISO 27001 information security international certification.
    • Use work experience and self-study to obtain AWS SAA Architect certification.
    • Invited to be the corporate speaker of the AWS Taipei Summit 2021.
  3. Government projects:
    • Taipei City Road Rate Website Development Project, responsible for overall website reconstruction and optimization.
    • New Taipei City automated valuation website development project, responsible for overall website development and maintenance.
    • Ministry of the Interior Periodic Housing Price Index Case, responsible for data ETL operations
    • Taipei city cadastral data research case, responsible for data ETL operations.
    • Tainan city cadastral data research case, responsible for data ETL operations.
    • New Taipei City cadastral data research case, responsible for data ETL operations.

Jul 2018 - Jan 2019

Data Engineer

InfiArk Inc.

Responsible for MongoDB massive data storage architecture and construction, AWS and Azure cloud platform management operations, backend API writing (Python Flask), and overall planning and architecture of the project system.

Project experience:

  1. The Taipei City Government’s transportation demonstration project :
    • Responsible for the construction of the data storage system of the forecasting system, and establish a fast response and stable system with MongoDB (Sharding) and MySQL (AWS).
  2. Car navigation system optimization case:
    • Data ETL operation (average 30 memos per month), a total of about 3Tib data volume per year, after the data is cleaned up, put it into the MongoDB cluster, implement 7 data partitions in the sharding way, to ensure that the data access response time can be 0.03 -Complete within 0.05 seconds.
    • Car speed real-time data prediction and timely data interface, design and complete the overall process of output prediction after the vehicle speed and real-time data interface (use the first 2 hours of data to predict, 15 minutes after the prediction, response time 1 minute)
    • Responsible for the establishment of all related services in Azure and AWS cloud. This project is built in Azure services.
    • Design and build a real-time data forecasting system for vehicle speed, and take the lead from the use of tools to platform architecture, the use of cloud service machine specifications, overall data growth estimation, forecasting process and resource evaluation.
  3. Medical disease prediction case:
    • Disease prediction API writing, users can input health check data through this API, and real-time query disease incidence rates online.
    • Use Nginx + Uwsgi to build API Server.

Jun 2017 - Nov 2017

Data Engineer

Blue Technology Inc.

Responsible for Python programming, MongoDB cluster database construction and maintenance, Spark computing cluster construction and development.
Project experience:
1. Concept verification of MongoDB and Spark big data analysis platform architecture

Jul 2007 - Dec 2016

Professional soldier

CGA

Served as a judicial police officer in the CGA, responsible for shore and sea patrols and investigations.

Certification