Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

How to weigh buying a home with cash instead of a mortgage Christina Majaski writes and edits finance, credit cards, and travel content. She has 14+ years of experience with print and digital ...

Claude Sonnet 4.6 beats Opus in agentic tasks, adds 1 million context, and excels in finance and automation, all at one-fifth ...