Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Abstract: Toward a next generation co-packaged optics, we have worked on a novel packaging substrate working as optoelectronic conversion engine and providing optical redistribution function and ...