Defeating Nondeterminism in LLM Inference
(thinkingmachines.ai)
328 points
by jxmorris12
4 days ago |
130 comments
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
()
