[WIP] [GSOC] KV Caching for LLM inference#27205

Draft

nklskyoy wants to merge 11 commits intoopencv:5.xfrom

nklskyoy:arg-cached

Commits on Apr 7, 2025

PagedCacheManager and DNN_ARG_CACHED
nklskyoy
committed

Commits on Apr 8, 2025

drop readNetFromGGUF
nklskyoy
committed

Commits on Apr 14, 2025

PagedCacheManager
nklskyoy
committed

Commits on Apr 27, 2025

Commits on May 9, 2025

bind cache to netimpl
nklskyoy
committed

Commits on May 10, 2025

Commits on May 11, 2025

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.

Alternative Proxies:

Alternative Proxy