Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
XDA Developers on MSN
I started using a shell that treats my terminal like a spreadsheet, and it's been a game-changer
Turning terminal noise into usable, readable data.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results