Prefill-as-a-Service:KVCache of Next-Generation Models Could Go Cross-Datacenter
(arxiv.org)
11 points
by matt_d
3 days ago |
0 comments
