Conformance

Conformance is the executable bar for an ASP operator. A conforming operator should pass the published conformance suite for the ASP version it claims.

Do We Need To Host The Tests?

Not as a browser-hosted runner. The tests should live in the ASP repository, versioned with the protocol, and be runnable from a developer machine or CI against any operator URL. The website should document how to run them, what they prove, and how claims should be worded.

Run The Suite

cd tests/conformance
ASP_OPERATOR_URL=http://127.0.0.1:8080 \
ASP_TEST_AGENTS="$(cat ../../examples/local-operator/seed.json)" \
uv run pytest

What Passing Means

• The operator satisfies the tested ASP invariants for that version.
• The operator handles required event and HTTP behavior consistently.
• Passing is a floor, not a complete proof of quality or security.

What To Publish On This Site

• The current conformance version and protocol version.
• The command to run the suite.
• A list of covered behavior and known gaps.
• Guidance for making ASP-compatible conformance claims.