Data Solution Architect, Sr. Data Engineer, Data Engineer Manager
uat-master, release news, unit tests and test coverage. • Using Airflow unified scheduler job, like cloud function scheduler, BQ scheduler, crontab, and ML model by R or Python ...etc. • Reduce Data Team 25% cost. • Create Data Team's first real-time ETL system via GKE, Pub/Sub and Memorystore for sending push notifications to users. • Create Data Team's first API via GKE for ML model , include achieve graceful shutdown , and run stress test via ApacheBench , and setup auto-scaling by hpa. 95% latency is under 200ms and RPS is over
Full-time / Interested in working remotely