Skills
Programming Languages
- Python, Flask, FastAPI
- Javascript, Node.js, jQuery
- Golang
- PHP, CodeIgniter, Laravel
- Shell scripts
Databases
- PostgreSQL
- MySQL, MariaDB
- MongoDB
- Neo4j
- Redis
Cloud Platforms
- GCP
- AWS
- Azure
DevOps
- CircleCI, Jenkins, GitHub Workflow
- Docker, Kubernetes
- Testing frameworks in Python, Javascript, Golang and PHP
Web
- RESTful and GraphQL API design
- Web crawling with headless browser
- SaaS, FaaS, Serverless system design
Auth
- OAuth2, OpenID Connect with JWT
- Open Policy Agent
- Keycloak
Work experiences
Tsaitung Agriculture Senior backend Engineer Jul 2022 -
Automatic order recognition system- Designed and implemented a reliable event-driven automatic order recognition system from scratch
- With a variety of image recognition and processing technique, we're able to automatically process orders in different formats from email attachments with >99% accuracy and minimum human intervention
- Implemented modularized and reusable system components with high extensibility and flexibility
Automatic stocks estimation and preparation
- Aggregated massive item, unit, supply, and inventory data to provide estimation of today and future needs, suggested amount to buy, demand trend, incoming items etc.
- Manage suppliers and its supplied items to automatically generate or combine purchase orders
- Reduces efforts by providing an intuitive overview for making everyday stocks decisions, while preserving all data for future analysis.
Cinnamon AI Senior Software Engineer Jul 2020 - Jul 2022
Authorization middleware with Open Policy Agent- Developed a generic authorization middleware for client projects and back ported to our services template with detailed documentation
- Hosted sharing sessions for other team members to understand about concepts of OPA and its dedicated REGO language
- Greatly reduced the efforts needed for future client projects that needs similar policy management
FaaS platform for AI pipeline with fission.io
- Containerized all AI models in the pipeline and make each of them as micro services which makes management of versioning, model weights and dependencies for each models hassle-free
- Concatenates each model services with MQT or HTTP, provides extremely flexible ways to composite AI pipelines with different sets, orders, or versions of AI models
- With power of fission and kubernetes, we have the ability to scale AI models individually to improve performance and prevent potential GPU memory leaks
Azure AD integration
- Survey and integrate Azure AD to our SPA+API system architecture with OAuth2 and OIDC
- Greatly reduced the efforts for PIC of other projects that needs the same functionality
- Implemented an audio player with streaming capability and waveform presentation to provide intuitive interface for users
- Dealing with large audio files by live transcoding and adjusting sample rate to acheive lowest latency
Services template for on-premise projects
- Made a sample structure with prebuilt microservices as a template for all future client projects
- Made modularized system components that allows easy adaption and extension
Awoo Inc. Backend Engineer Apr 2017 - Apr 2020
Search engine result page crawler
- Crawl with extremely high performance with no blocking, a cluster of crawlers can fetch more than 1000 pages per minute
- Refactor the code base from PhantomJS to puppeteer, which cuts the failure rate in half with enhanced error handling, readability, and the ease of maintenance.
- Polymorphically crawls different search engines, regions, and devices to provide variety of data for SEO
Data warehouse and ETL
- Implemented data caching and layering for designing high performance APIs that responses within 50ms
- Ensure reliability for processing terabytes of dataset composed of hundreds of millions of crawled results and google analytics records
- Deploy and monitor each step of the data processing with Dataflow runner, reduce the costs of BigQuery by at least 30% from examining number of bytes each query actually reads
Postfix after-queue content filter
- Refactor the code base from PHP to Go which improves the mail throughput by 300%
- Designed with minimum CPU/RAM footprint and multi-threading in mind, handles more than 4000 mails per minute
Misc - Participated community projects and personal toy projects
- rotki - An open source portfolio tracking, analytics, accounting and tax reporting tool that respects your privacy.
- Swar-Chia-Plot-Manager - A plot manager for Chia plotting
- qmk_firmware - Powerful firmware for mechanical keyboards
- redis-stream-queue - Simple reliable message queue implemented using Redis Stream and PHP
- 591-notifier - Simple crawler for 591 that watches new house posts and send notification to discord
- maomaochong - A space shooter type browser game written with phaser.io
Education
National Chung Cheng University, 2014 - 2018
Computer Science and Information Engineering
