Show HN: Shoehorn – Quantize any model down to run on your machine (notactuallytreyanastasio.github.io)
67 pointsby rhgraysonii3 days ago17 comments
Working on Mac, Linux, and Windows now. I include a simple GUI to find new models and get things built and set up. It is working quite well across a few models for me. The GitHub README and DESIGN.md files go into detail of the how/why and it's working remarkably well so far. https://github.com/notactuallytreyanastasio/shoehorn