Applications for this position are currently paused

爬蟲工程師

Save
Job updated 9 months ago

Job Description

工作內容:

1.負責爬蟲系統的核心技術研究、架構設計、系統規劃

2.負責爬蟲核心演算法的策略優化,提升網頁抓取的效率和品質

3.研究各種網頁、微信、app介面,實現多通道抓取

4.反爬策略的設計及優化

5.負責業務需求分析、系統設計、開發計畫的制定與跟進

6.負責爬蟲系統研發過程跟進、代碼review、品質控制

Requirements

1、負責開發網頁數據的自動化爬取程式及自動化解析程式,清洗、分類已解析的互聯網資料

2、負責自動化資料解析系統的部分模組開發,參與核心爬蟲系統架構設計、資料庫設計,分析爬蟲系統的技術缺陷,對策略架構做出合理地調整和改進

3、電腦、軟體、電子資訊等相關理工科專業,2年以上相關工作經驗且精通Python語言,熟析網路架構,熟析爬蟲程式原理,以及自動上傳

精通一種開源爬蟲框架,有開發爬蟲框架及自動上傳的經驗優先

4、熟悉多執行緒、網路程式設計,精通網頁抓取原理及技術,精通規則運算式,能從結構化的和非結構化的資料中獲取資訊,且熟練使用MySQL資料庫,掌握Redis、MongoDB、Hive等常用NoSQL

5、善於溝通,有良好的文檔寫作能力,口頭溝通能力,良好的團隊合作精神,良好的抽象思維。

View all jobs
View all jobs
Save
Personal Invitation Link
This is your personal referral link for job invitation. You'll receive an email notification when someone applied for the position via your job link.
Share this job
People who applied for this job also applied for
Logo of the organization.
Full-time
Mid-Senior level
1
45K ~ 65K TWD / month
Logo of the organization.
Full-time
Entry level
6
40K ~ 55K TWD / month
Logo of the organization.
Full-time
Entry level
1
55K ~ 80K TWD / month
Logo of Glory Information Ltd..
Glory Information Ltd.
Mobile Apps
201 - 500 people

About us

本公司深感移動裝置已成為全球商務往來的主流,加上跨域電商時代的崛起,於是全力向移動裝置與電商平臺的應用開發衝刺,並向全世界開放徵才。

2018年至今,除了台北外,依據承接業務特性及事業部不同,已遍佈在上海、深圳、日本、新加坡、泰國、美國、加拿大成立各個子公司。

Glory Information Ltd. was founded in 2018 and professionalized in mobile devices/ applications. Glory Information Ltd. believes that mobile devices and e-commerce have become the mainstream of global business transactions. Therefore, with the mobile devices era Glory Information Ltd. created applications and e-commerce platform for the world business today.

The founder of the Glory Information Ltd. promotes internationalization and diversified development strategy actively, which contributes to the local economic development. The Glory Information Ltd.'s footprints are spread across China (Shanghai & Shenzhen), Taiwan, Japan, Singapore, Thailand, America and Canada. As the business expands, we will move further afield.


Team

Avatar of the user.
HR
Avatar of the user.
HR-Recruiter
Avatar of the user.
HR- Recruiter

Jobs

Full-time
Mid-Senior level
4
60K ~ 100K TWD / month
Save

Full-time
Mid-Senior level
3
40K ~ 100K TWD / month
Save

Full-time
Mid-Senior level
3
38K ~ 100K TWD / month
Save