Testers may conduct adversarial “red-team” assessments, including attempts to prompt-inject or jailbreak systems—i.e., try to circumvent model safeguards and induce policy-violating or otherwise unsafe behaviour.
The assessment scope can cover:
Applicants will be assessed on both their testing capability and their organisational capacity:
The Starter Kit is voluntary guidance for baseline LLM safety and reliability testing. Its five stated risk areas are:
The intended benefit is a more consistent and credible external-testing market: common expectations for tester competence, evidence-based and documented assessments, and testing tailored to the organisation’s AI use case and risk scope.
Industry representatives’ specific comments about improved customisation, governance or confidence were not included in the available evidence. However, the programme’s stated design supports those outcomes by helping buyers identify capable testers, making the test scope explicit, and giving deployers additional assurance from independent assessment.
Testers may conduct adversarial “red-team” assessments, including attempts to prompt-inject or jailbreak systems—i.e., try to circumvent model safeguards and induce policy-violating or otherwise unsafe behaviour.
The assessment scope can cover:
Applicants will be assessed on both their testing capability and their organisational capacity:
The Starter Kit is voluntary guidance for baseline LLM safety and reliability testing. Its five stated risk areas are:
The intended benefit is a more consistent and credible external-testing market: common expectations for tester competence, evidence-based and documented assessments, and testing tailored to the organisation’s AI use case and risk scope.
Industry representatives’ specific comments about improved customisation, governance or confidence were not included in the available evidence. However, the programme’s stated design supports those outcomes by helping buyers identify capable testers, making the test scope explicit, and giving deployers additional assurance from independent assessment.