1. 雲端服務開發與資料系統開發 2. 熟悉Kafka、HBase及Hadoop等分散式系統 3. 熟悉應用程式介面(API，如：RESTful/HTTP、gRPC等)之規格制定、開發與驗證 4. 熟悉大型系統之高階架構設計，包含後台應用程式、儲存系統之整...

- Deploying and maintaining tracking system to monitor the platform (e.g. Prometheus, Grafana). - Deploying and maintaining large scale distributed applications (e.g. Spark , Kafka, Cassandra). - Customizing the AI Data Pipe Line according to customer need. - Willing to learn new technologies....

[PI資料工程團隊簡介]With increasing velocities, varieties and complexity of data at PI, the PI Data Engineering Team becomes the important role supporting existed or new projects using big data techniques to manipulate large streaming/batch dataset with various format on highly efficient way. [工作內容]● 維運 Hortonworks HDP, Cassandra NoSQL Cluster, Kafka Cluster, Redis Cluster, ELK, K8S,MQTT● 各服務元件的Performance Tuning, Log Monitoring...

1. 發展資料儲存、資料結構、資料傳輸、資料應用、系統監控等大型交易系統軟硬體架構 2. 新技術研究、導入、應用 3. Java web application, API 架構制定...

1.資料邏輯處理：資料萃取、清理、ETL 2.熟悉程式語言:Python、Golang、SQL 3.熟悉kafka、ELK、grafana ...

1. 系統平台開發 2. 撰寫開發、維運文件  3. 執行業務系統上線支援...

1. 帶領團隊參與Supply Chain Management System專案2. 專案管理3. System Design4. Code Review5. Issue/bug fix...

• Design, construct, install, test and maintain highly scalable data pipelines with state-of-the-art monitoring and logging practices. • Investigate and resolve performance and stability issues in data processing systems and advise necessary infrastructure changes• Select and integrate data tools and frameworks required to provide requested capabilities• Recommend ways to improve data reliability, efficiency and quality.• Collaborate with Data Scientists, DevOps and Project Managers on meeting project goals....

參與需求討論與分析，根據需求進行 API服務設計以及開發與測試等工作整合架構的相關微服務功能設計開發與測試及維運等相關工作開發Event Sourcing 相關應用服務參與建置PaaS平台(K8S/OpenShift)環境、CI/CD...

or new projects using big data techniques to manipulate large streaming/batch dataset with various format on highly efficient way. [Responsibilities] ● Design and implement data processing pipeline for ETL/ELT job on Hadoop and Spark eco-systems.● Ingesting data from different sources to Kafka and HDFS/HIVE.● Design appropriate data schema on NoSQL database for low latency query on large scale dataset.● Build web services to provide interface to access data stored in NoSQL or SparkSQL....

Design and grow the Shopee data platform to support a variety of big data applications using open-source technologies including Kafka, Hadoop, Presto, HBase, Spark, Hive, Druid, and our own creations. Some examples include a real-time data streaming platform, a unified query platform, a cluster management system, and a machine learning platformDesign and grow Shopee’s data warehouse, build reliable and smart ways to ingest data to the warehouse, and help engineer efficient data pipelines. Some examples include self...

【工作簡介】  你邏輯清晰，龐大且雜亂無章的資料，經過你的設計的資料架構、收集、清洗後，便成了分析師好用的資訊嗎？你膽大心細，富有組織能力又有工程師的實作經驗，並尋尋覓覓一個以data-driven的...

職位內容 Vpon 的廣告系統由數十個分佈在不同區域的分散式子系統組成，每天系統需要處理上億筆的流量數據。 SRE 團隊負責維護系統整體的性能以及穩定性，作為帶領這個部門的技術主管我們...

- Developing AI Managed Services ideas for new programs, products, or features by monitoring industry developments and trends. - Collaborating with the front-end developers and other team members to establish objectives and design more functional, cohesive codes to enhance the user experience....