Skip to content

Changelog

All notable changes to METIS will be documented here.

[0.1.0] — 2026-05-26

Added

  • Initial public release
  • 48 metrics across Fidelity (26), Utility (5), and Privacy (9)
  • Empirical bound calibration with caching
  • Stochastic dominance aggregation
  • Benchmark mode with Friedman-Nemenyi statistical testing
  • 13 generators (7 baselines + 6 SOTA)
  • CLI with evaluate, calibrate, and version commands
  • Python SDK with Evaluator class and evaluate_from_config()
  • YAML-driven configuration
  • JSON and Markdown report generation
  • Multi-run evaluation with cross-run statistics
  • SonarCloud integration for code quality
  • MkDocs documentation site
  • PyPI publication as metis-val