Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

The European Parliament disabled built-in AI features on lawmakers’ work devices, citing unresolved cloud-processing security and privacy risks.