Open-sourced my Apple Foundation model eval suite

Not sure about you, but I find evals for Foundations models a bit messy.

Its completely local, and supports the models already on your Mac. Also supports Core AI.

Supports MacOS 27 and includes the new features for it.

Best part? Your agent can control it all through MCP 🙌

On GitHub here: https://github.com/coryparrry/Foundation-Eval-Labs