A cryptographic enclave keeps both AI weights and hidden safety tests secret
Google DeepMind, the Singapore AI Safety Institute, OpenMined, AVERI, and MLCommons are piloting what they describe as the first double-blind evaluation of a proprietary frontier-class AI model. The project tests Gemini Flash Lite against confidential benchmarks inside a privacy-preserving environment built with Google Cloud Confidential Space. The evaluator cannot see the model weights, and Google cannot see the evaluation prompts. Cryptographic verification is intended to reduce benchmark contamination while protecting both sensitive tests and proprietary intellectual property. That matters when a model could otherwise see the exam before deployment, especially for cybersecurity or government evaluations whose prompts may themselves be sensitive. The pilot is an architectural advance, not a universal seal of trustworthy evaluation. A secure enclave does not prove that the benchmark measures the right capability or harm, that the implementation has no vulnerability, or that a tested model behaves identically after deployment. The next standard should combine cryptographic separation with independent methodology review, reproducible evidence, transparent limitations, and testing across providers rather than treating secrecy alone as scientific validity.
