CakeResume
CakeResume Logo
Log In
Sign Up
Build your Network
My Network
Access your personal network connections and manage your contacts.
CakeResume Meet
Expand your professional network by meeting and connecting with other users.
Community
Engage with other users through discussions, forums, and networking events.
Log In
Sign Up
Portfolios
嘉鈞張
InnoTIS, an Inference website based o...

InnoTIS, an Inference website based on Triton

Avatar of 嘉鈞張.
Avatar of 嘉鈞張.

InnoTIS, an Inference website based on Triton

By嘉鈞張
Senior Software Enginner
・
New Taipei City, Taiwan

InnoTIS, an inference website based on Triton

2021/11~2022/1

# POC # Triton # TensorRT # Stream # Flask # C++ # JavaScript

  • To make it easier and keep the advantage of the NVIDIA Triton Inference Server, we package the gRPC API and design an easy-to-use website.
  • Create a Website from sketch and using pure HTML, CSS, and Javascript.
  • Custom TensorRT C++ Plugin for custom YOLOv4 trained from Darknet.
  • Dockerize, make it more flexible and deployable.


To make it easier and keep the advantage of the NVIDIA Triton Inference Server, we package the gRPC API and design an easy-to-use website. Create a Website from sketch and using pure HTML, CSS, and Javascript. Custom TensorRT C++ Plugin for custom YOLOv4 trained from Darknet. Dockerize, make it more flexible and deployable.
Avatar of the user.
Please login to comment.
嘉鈞張
Published: Sep 10th 2023
30
5
0

Tools

python
Python
javascript
JavaScript
css3
CSS3
html5
HTML5
bootstrap
Bootstrap
C++ Plugin
TensorRT
Streaming
Flask
Inference Tool
Triton Inference Server

Share

Other works from 嘉鈞張

Cover of iVIT-I, an heterogeneous inference SDK.
iVIT-I, an heterogeneous inference SDK
Cover of iTAO, a trainning tool integrate with TAO tookit.
iTAO, a trainning tool integrate with TAO tookit
Cover of AIoT專案實作 - 智慧點名系統.
AIoT專案實作 - 智慧點名系統
Cover of Shoes Coloring on Jetson Nano.
Shoes Coloring on Jetson Nano
Cover of 自動清潔粉塵系統之原型.
自動清潔粉塵系統之原型
Cover of 台灣路況偵測、使用者手勢辨識.
台灣路況偵測、使用者手勢辨識