OCP Diag AutoVal Framework

Overview

AutoVal is Meta's open-source SSD test framework, released on GitHub in collaboration with the OCP test workstream, that provides a shared qualification test suite usable across Meta, ODMs, and SSD vendors. The framework follows a setup/execute/cleanup test lifecycle, supports multi-step validation with individual pass/fail verdicts, offers reusable shared libraries, and provides SSH-based environment control for DUTs and BMCs. It generates OCP Diag-compliant JSON output containing configuration details, test parameters, timestamps, and complete execution history, enabling programmatic analysis and shared debugging across labs.

Using AutoVal, Meta reduced its SSD firmware regression qualification time from 8 weeks to 6 weeks (a 25% reduction) by enabling SSD vendors to run the same test cases in their own labs before firmware release. The rollout ran from Meta discontinuing internal/external support for its Hi5 framework (November 2023), through NDA test sharing (Q1 2024), the public AutoVal release and initial subset of test cases on GitHub (May 2024), full vendor alignment (November 2024), and joint qualifications (H1 2025); as of June 2025 all of Meta's SSD qualification test cases are on GitHub. SSD security test cases were planned for release to GitHub in Q4 2025.