Scikit-Learn libraries for predictive analysis of customer behavior. Designed and implemented a scalable data warehouse architecture using Apache Cassandra, PostgresDB, and Redis. Optimized database performance by tuning queries in SQL Server, Oracle and PostgreSQL databases. Implemented efficient data processing algorithms on large datasets with Apache Spark, MapReduce, and Pandas Python. Created dashboards in Tableau Desktop Professional Edition to visualize complex datasets in an interactive manner. Created custom scripts to automate the extraction, transformation, and loading of Big Data into distributed systems. Utilized Amazon Web Services components such as EMR and S3 buckets for
Taipei,TW [email protected] EDUCATION National Cheng-chi University (NCCU), Master's degree, Computer Science,~Member of DataBase Lab for research computer science. Focus on Big-Data , machine learning , Data mining , information retrieval , Advanced Database System . Master's thesis is Efficient Skyline Query Processing with MapReduce . Content is how to improve processing skyline query in huge data environment. National Taiwan Normal University(NTNU), Bachelor's degree, Industrial Education,~Research on using software design course to improve students' learning efficiency. Special Topic is using machine learning to make the camera learn to capture
Site Reliability Engineer @TSMC_台灣積體電路製造股份有限公司(台積電)
・
2022 ~ Present
Backend Engineer
Within one year
Travis Shen I have 5-years of experience in web back-end (Python) and 3-years of experience in cloud operation (GCP). Interested in Web API, Linux Container, CI/CD, and Cloud Architecture. [email protected] / super9.space Work Experiences Backend Engineer @ Tagtoo / 2,, 2021 Real-time IoT Event/Entity Data Streaming Design a streaming system using Pub/Sub and micro-services to replace the old one (MapReduce on GAE), reduced 80% cost, gained 10x higher throughput. Compress the event data with Dataflow to fit the
Education Administration Officer @National Defense University (Taiwan)
・
2017 ~ Present
Information Security Analyst/Programmer
More than one year
Tao-hsiang Chang General leadership/communication skills and ability to work under stressed environment are trained for five+ years as a Naval officer. Skilled in networking/programming abilities including data-mining knowledge for my CS/EE/Mathematics background and Java/MapReduce/AWS experience in the Master's Thesis. Other than Chinese, I'm also capable of working with English/Japanese personnel for the education background and experience as a Liaison Officer. Education Administration Officer, CCIT, NDU Taoyuan City, Taiwan [email protected] Skills Language English: BS&MS
Apache Spark First people in Taiwan who pass the Certified Apache Spark Developer. Have experiences on Spark consulting and architecting, in addition a lecturer for customer. Hadoop & HBase Have about three year experiences on Hadoop & HBase developments. Help our product to build on the HBase and Hive, MapReduce or other big data solution Node.js So far I focus on the front-end and Node.js development. Have more than two year experiences on both. React.js This is favor front-end framework than Angular.js and Backbone.js.