Yen-Ting Liu 我具有5年python資料分析,熟悉以Docker搭配nginx, redis部屬api及系統於GCP上。熟悉Airflow程式及報表自動化分析流程,並有Hadoop,Elasticsearch群集管理實務、pyspark數據ETL經驗。我喜歡學習新技術,並追求以更高效率進行資料處理流程。 Santa Clara, CA, USA [email protected] 工作經歷 Data Engineer
scraping running scripts.( Flask ) Write and maintain web scraping scripts on distributed system.( Python + Celery + RabbitMQ / Redis ) Largitdata, Web Scraping Intern Jan 2017 ~ Aug 2017 Write many web scraping scripts for various sorts of websites. Skills Languages - Python , Scala Big Data Framework - Apache Spark, Hadoop/HDFS, GCP BigQuery, GCP Dataflow Cloud Platform - Google Cloud Platform Version Control - Git Interest Basketball 3 yrs on NTUEE girls' basketball team. Captain of the NTUEE girls' basketball team for one year. Psychology Took many courses in psychology department and cognitive neuroscience. Language Interest in
策會 Dec 2017 ~ Jun 2018 Taoyuan, Taiwan 受訓約6個月 學習項目眾多,各項技術僅入門 學習內容: MySQL Java JavaScript html linux ELK(Elasticsearch、Logstash、Kibana) Docker data mining AWS ETL NoSQL(mongodb、redis) SPSS IOT hadoop、saprk R Django 其他(補充) 平日有使用excel記帳,檔案同步至onedrive,並使用 power bi 呈現圖表資料(如下圖:可篩選時間軸 分類等等...) 之