演講 / Speaking

Triton as NLP Model Inference Back-end

日期 / Date
2022/11/05
類型 / Type
演講 / Speaking
活動 / Event
PyCon HK
地點 / Location
Live stream

Context

內容摘要

中文

這場演講是我在 PyCon HK 所分享的內容。本次為全英文分享。 我介紹了 Triton Server 的基本機制,並且以 Live Demo 的方式部署了一個 NLP model 到 Triton Server。

English

This speech was shared in PyCon HK, which is the largest Python conference in Hong Kong. This is a English session. I introduced basic knowledge of Triton Inference Server and deploy NLP model to Triton with a practical sample.

Details

技術分類與活動連結

主題

  • Python
  • NLP

主要連結

Event Records

活動紀錄

Triton as NLP Model Inference Back-end
Screenshot / 截圖
Triton as NLP Model Inference Back-end
Screenshot / 截圖