Testing & verification
Conformance
Conformance is not binary. Every byre specification defines three levels, each independently useful. Self-certification is the default. Third-party verification is optional.
This part of byre is in preview and under active development. Some pages are incomplete, and details may change.
The three levels
The minimum to be a valid implementation. Covers all MUST requirements at the core level: correct syntax, unique ids, structural validity.
Any implementation that claims to process or produce draft documents.
Run the core test suite. All tests must pass. Self-report results alongside your implementation.
Adds machine-testable requirements: round-tripping, id resolution, check-type declarations, position attachment. Everything at this level can be verified without human judgment.
Tools and libraries that parse, validate, or transform specifications.
Run the validatable test suite. Report pass/fail per test case. Partial results are acceptable — declare which cases pass.
Complete conformance. All MUST and SHOULD requirements, self-validation, format-agnostic rendering. Required for reference implementations.
Reference implementations and tools that claim to be canonical.
Run the full test suite. All tests must pass. Self-validation required: your tool must validate the draft spec against itself.
Self-certification
Implementers verify their implementation against the test suites. Self-certification is not a lesser form of conformance — it is the primary form. Third-party verification adds a signed attestation; it does not change the underlying test results.
Choose a specification and the conformance level you are targeting.
Obtain the conformance suite for that spec and level.
Run the test harness against your implementation.
Collect results: pass/fail per test case, optional features, any deviations.
Publish your conformance report alongside your implementation.
Third-party certification
What it adds
Independent test execution by byre. A cryptographically signed attestation. A provenance chain that can be verified by anyone.
What it does not add
Different tests. A higher conformance bar. Any requirement that is not already in the test suite. Certification runs the same tests you run yourself.
Who needs it
Implementations that need to demonstrate conformance to a third party — procurement requirements, enterprise buyers, regulated environments — where self-reported results are not sufficient.
Request certification
Contact standards@byre.dev with your implementation details and the conformance level you are targeting. We will respond within five business days.