Editorial draft available to read. Factual and language review is pending. Examples are illustrative.
Decision and scope
Version instructions together with their purpose, owner and compatible sources. Distinguish wording adjustments from changes to permissions and answer rules. A useful comparison preserves questions and expected outcomes; inspecting two instruction texts alone cannot show whether the assistant has become less reliable in real use.
Illustrative example
Illustrative example: a new instruction summarizes orders by region. Test an allowed region, a restricted region and an order without a region. If the document index also changes, record both versions. Otherwise a different result may be incorrectly attributed to the wording rather than the available evidence.
Acceptance check
Compare correct answers, omissions and unauthorized responses before activation. Preserve the previous version and the approval decision. Accept the change when relevant tests pass and it is possible to reconstruct which instructions, configuration and sources produced every response used in the evaluation.
Key takeaways
- Accept the change when relevant tests pass and it is possible to reconstruct which instructions, configuration and sources produced every response used in the evaluation.