Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Abstract: In this paper, we embark on a meticulous investigation of anomaly detection within OpenStack system logs, employing a two-pronged approach that ingeniously combines a task splitting method ...

A Python package for reformatting and accessing demand, solar generation and wind generation time series data used by the Australian Energy Market Operator (AEMO) in their Integrated System Plan (ISP) ...

Traditional log analysis relies on keyword matching, which fails to capture semantic meaning. Engineers searching for "database connection failed" miss logs containing "db timeout" or "SQL server ...