Data Engineer

Big Data Innovation Team, Information Technology Dept., Realtek
(Feb. 2018 – Present)

 Responsibility 

• Develop every component in ETL process, which (1) extracts data by developing web crawlers and document parser, and then (2) transforms data by open source approaches such as pandas, finally (3) loads results into NoSQL / SQL Databases according to project requirements.

• Research on deep learning solutions to different problems. Primarily use Keras to do semantic analysis on unstructured data. Secondarily building pipeline and process heterogeneous documents using open-sourced methods. 

• Build and introduce Git flow and Jenkins CI server for affiliated team. Set up virtual environments for development integrity of projects, providing team members with modularizing code snippets. 

• In most projects take charge of version control, production deployment, system administration, backup and restore, execution log analysis, and also work as an advisor for cutting edge technology. 

Served as an internship mentor, leading 2 project members to build a machine learning model of License Plate Recognition System and implementing access control framework. Initially, we collected license plate dataset with labels and trained one CNN model for locating plates and another RNN model to recognize plate numbers. Then, we developed Flask APIs to receive video frames from web cams, calculating edit distance as similarity between predicted plate numbers and those from company database. Finally, we could control the entrance gate by checking whether the vehicle owner is our employee. Our system’s prediction accuracy reached 90% in the examination. 

Associate Engineer

Digital Service Innovation Institute, Institute for Information Industry
(Mar. 2016 – Feb. 2018)

 Responsibility 
 

• Existent RESTful APIs maintaining and refactoring, develop new APIs with Python which provides fast prototyping and flexibly interfacing with different data source. 

• Discover or hack website APIs, rapidly develop web crawlers for sites with large numbers of users like Facebook, PChome, and Dcard. Deploy crawler programs for routine jobs or one-off tasks. 

• Develop automated tools from scratch, divide and conquer tasks with large quantity of data, and improve analysts’ routine work efficiency.  

To collect food safety news and its attachments, I developed 23 crawlers for 22 Departments of Public Health in Taiwan and 1 Gmail account inbox. The crawled text was processed to alert schools to the use of illegal ingredients. Since the program structure and syntax in above 22 web crawlers was alike and reusable, I created a Github project and committed all my codes for someone’s need in crawling Taiwanese Government official sites. 

Master of Information Systems and Applications, National Tsing Hua University 

(Sep. 2012 – Jan. 2016)

• Implemented a mechanism to discover potential pages in Facebook posts on the purpose of enriching existent data
  

System Administrator (National Tsing Hua University Publisher)

• Developed a full text search system to find keywords in corresponding pages of published books
  
• Implemented a URL redirection plan to avoid site address recorded on books from being invalid 
  
  
  
  

Bachelor of Computer Science and Information Engineering, National Chung Cheng University
(Sep. 2008 – Jun. 2012)

• Developed an Android application featuring a social media platform which let users exchange name cards on both business and daily life side
  

Director of Network Administration (Campus Network Association)

• Led network administrator teams to maintain network devices in campus dormitory and provide consulting service

Kaohsiung Senior High School 
(Sep. 2005 – Jun. 2008)