Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Tierney Plumb is an editor of Eater’s Northeast region, covering D.C., Boston, Philly, and New York. Pasta lovers know there’s no such thing as too much pasta. Whether a craving calls for spaghetti, ...