Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Abstract: Software testing is a fundamental stage in the Software Development Life Cycle (SDLC), indispensable for detecting errors and lowering overall maintenance costs. Automated test generation ...