AI推理部署加速
Pinned Loading
Repositories
Showing 6 of 6 repositories
- nndeploy Public
nndeploy is an end-to-end model deployment framework. Based on multi-terminal inference and directed acyclic graph model deployment, it is committed to providing users with a cross-platform, easy-to-use, and high-performance model deployment experience.
nndeploy/nndeploy’s past year of commit activity - safetensors-cpp Public Forked from syoyo/safetensors-cpp
Header-only safetensors loader and saver in C++
nndeploy/safetensors-cpp’s past year of commit activity - tokenizers-cpp Public Forked from mlc-ai/tokenizers-cpp
Universal cross-platform tokenizers binding to HF and sentencepiece
nndeploy/tokenizers-cpp’s past year of commit activity - Awesome-LLM-Inference Public Forked from DefTruth/Awesome-LLM-Inference
💻A small Collection for Awesome LLM Inference [Papers|Blogs|Docs] with codes, contains TensorRT-LLM, streaming-llm, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
nndeploy/Awesome-LLM-Inference’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…