Data Pipeline Spark Data Report

1. Use daily batch file to automatically do data ETL with oracle web services & MySQL. 2. Use EDA skills to help Quality apartments visualize history trend of reject cell test. 3. Use machine learning to predict probability of cell test reject rate. 4. Use Tableau to visualize model predictions and history trend to help OQC users enhance the benefit of random inspection. 5. Developed a simple terminal toolkit to let other colleagues monitor model health and apply auto-retrain when the model expired.

1. Use NLP skills to analysis Consumer dispute data from government's department. 2. Frontend coding and data visualize with D3.js. 3. Research how to use two PostgreSQL container to auto Backup. 4. Data collation and cleaning with pandas & MS-SQL. 5. Build a RESTAPI service for Social Network Analysis.

1. Develop/Maintain a versatile SalesKit system under Business Process Management. 2. Collect internal system data by scheduled crawler and combine multi data source to Database automatically. 3. Visualized customer limit data to help Treasury Market Units simplify deal check. 4. Build development flow with Git to make production environment cleaner and reliable. 5. Use Bloomberg, Reuters API to fetch daily FX close rate and visualize with line chart.