Changelog¶
All notable changes to METIS will be documented here.
[0.1.0] — 2026-05-26¶
Added¶
- Initial public release
- 48 metrics across Fidelity (26), Utility (5), and Privacy (9)
- Empirical bound calibration with caching
- Stochastic dominance aggregation
- Benchmark mode with Friedman-Nemenyi statistical testing
- 13 generators (7 baselines + 6 SOTA)
- CLI with
evaluate,calibrate, andversioncommands - Python SDK with
Evaluatorclass andevaluate_from_config() - YAML-driven configuration
- JSON and Markdown report generation
- Multi-run evaluation with cross-run statistics
- SonarCloud integration for code quality
- MkDocs documentation site
- PyPI publication as
metis-val