Evaluating the Critical Risks of Amazon's Nova Premier under the Frontier Model Safety Framework
Not on the map. Why?
Abstract (arXiv)
Nova Premier is Amazon's most capable multimodal foundation model and teacher for model distillation. It processes text, images, and video with a one-million-token context window, enabling analysis of large codebases, 400-page documents, and 90-minute videos in a single prompt. We present the first comprehensive evaluation of Nova Premier's critical risk profile under the Frontier Model Safety Framework. Evaluations target three high-risk domains -- Chemical, Biological, Radiological & Nuclear (CBRN), Offensive Cyber Operations, and Automated AI R&D -- and combine automated benchmarks, expert red-teaming, and uplift studies to determine whether the model exceeds release thresholds. We summarize our methodology and report core findings. Based on this evaluation, we find that Nova Premier is safe for public release as per our commitments made at the 2025 Paris AI Safety Summit. We will continue to enhance our safety evaluation and mitigation pipelines as new risks and capabilities associated with frontier models are identified.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Jul 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Emergent Strategic Reasoning Risks in AI: A Taxonomy-Driven Evaluation Frameworkcited by 1
- 2026RCTs for Frontier AI Governance: Methodological Challenges and Solutions for Human Uplift Studiescited by 0
- 2026A Threshold Exceedance Framework for CBRN Uplift Evaluation in Frontier Language Modelscited by 0
- 2026A Threshold Exceedance Framework for CBRN Uplift Evaluation in Frontier Language Models13 Jul 2026
- 2026Emergent Strategic Reasoning Risks in AI: A Taxonomy-Driven Evaluation Framework23 Apr 2026
- 2026RCTs for Frontier AI Governance: Methodological Challenges and Solutions for Human Uplift Studies11 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Evaluating Nova 2.0 Lite model under Amazon's Frontier Model Safety Framework
- 2025Quantifying CBRN Risk in Frontier Models
- 2026ForesightSafety Bench: A Frontier Risk Evaluation and Governance Framework towards Safe AI
- 2024Benchmark Early and Red Team Often: A Framework for Assessing and Managing Dual-Use Hazards of AI Foundation Models
- 2025Frontier AI Risk Management Framework in Practice: A Risk Analysis Technical Report
- 2025Safety Evaluation and Enhancement of DeepSeek Models in Chinese Contexts
- 2025A Different Approach to AI Safety: Proceedings from the Columbia Convening on Openness in Artificial Intelligence and AI Safety
- 2025Early External Safety Testing of OpenAI's o3-mini: Insights from the Pre-Deployment Evaluation