Jul 2018 - Present
1.Optimized the whole data pipeline to increase data data processing by 30%
2.Establish automatic procedures to reduce 50% of human operations and human errors by 80%.
3.Refactor some legacy codes like shell script by python and optimized the execution time from 10 minutes to a few seconds.
4.Maintained more than 100 Linux based physical server to ensure the operation of data pipeline.
5.Cooperate with customers to build the new system and update the new Spec.