Uvicorn, Gunicorn 開發RESTful API 及設計 MongoDB schema並使用 Docker-compose 進行開發與部署- 負責開發資料庫 Connector 操作頁面(支援 Impala, Kudu, PostgreSQL, MySQL, MS SQL, Oracle)、 Record Controller 功能、平台 Pipeline 中檢視資料的視覺化功能，以及熟悉 Nifi 各種Processor 功能加入系統中 - 協助用戶建置及改善 ETL Pipeline 效能 Line Notify 服務系統： - 設計系統

Solutions Architect CKmates Responsible for AWS cloud architecture and solution design. AprJan 2023 Cloud Data Engineer SinYi Realty Inc. Responsible for Azure cloud architecture and Data ETL Pipeline development and management. JanApr 2022 Backend Engineer AnFu Solutions Inc. Responsible for AWS cloud environment management and architecture, ETL data cleaning, and Python API development. Project experience: House+ : Data cleaning process management, using Elastic Beanstalk in the AWS cloud environment to establish a data cleaning process pipeline. Model training process management, using Elastic Beanstalk in the AWS cloud environment to establish a model training process

for business process automation using data techniques on loan, credit analysis and procurement process. • Design solutions for data leakage prevention and data security. • Implement end-to-end generative AI solution integrating with GraphDB, Chatbot & Avatar. Morrison Express Corp., Data Engineer, Jan 2021 ~ Jul 2022 • Orchestrated data pipeline, ETL process and API to connect diverse data systems and facilitate data migration. • Full accountability for overseeing data architecture and services spanning 70 offices across five continents. • Integrated AWS cloud services, optimizing applications with S3, Lambda, SQS, SNS, and ECS. ASUSTeK Computer Inc., Digital Analyst

Git #Bootstrap #HTML/CSS #SpringBoot #PlayFramework #CodeIgniter #Tomcat #Jersey #Jetty Work Experience Senior Software Engineer • Innova Solutions Taiwan 2023/03 - Present Data Platform - Alchemy Team 1. The key person to create an automation testing framework for cross-team spark ETL modules. 2. Using Gitlab-CI to streamline the upstream and downstream projects across different teams. 3. Create and design the test plan based on Gitflow. 4. Create the activity log reporter in the pipeline using SNS. 5. Remove the Glue crawler

to the old version of the homepage of the Bank. They have successfully provided about 300,000 business conversions every month, including online card applications, asset products, trading services, etc, s ince the service was launched inAugMay 2020 R&D LoFTechnology, inc Transformation of VM-based service into Kubernetes on production From zero to one research task, and mentor other team members Kubernetes/ansible/drone/bitbucket-pipeline On-premise Kubernetes cluster deploys solution provider. Resolving production service performance issues Implement container base CI/CD pipeline replacing legacy manual deploy Launch a...

in practical scenarios, it's surprising to see some fundamental algorithms can show us more insights. PySpark dataframe programming Recommendation algorithm design, improved and achieved the best performance at that tim e Various classification tasks User profile construction with NLP. Information retrieval based chat bot Data warehousing and ETL management (Febnow) I created some tools(e.g., airfly ) to help us management our data more efficiently. Based on PySpark Auto DAG generator : automatically resolve and build the task dependencies for our data pipeline Metadata management. More easier to perform data analytics such as EDA