Rai: CPU-only LLM inference engine in pure Rust

(github.com)

4 points | by simonpure 3 hours ago

0 comments