Reflection releases Beam security technical report
Beam Safety Technical Report
Reflection released the Beam safety technical report, disclosing the model's evaluation results and OSF risk determinations for four risk categories: biological, chemical, loss of control, and cyberattack. Safety post-training used Deliberative Alignment, generating SFT trajectories in two stages, and in RL, a context-aware judge optimized both refusal and reduction of over-refusal, with safety environments comprising 5% of the training data mix. In biological evaluation, Beam ranked first among 13 models with 61% accuracy on the Human Pathogen Capabilities Test, and second with 64.6% on BioTIER high-risk refusal. For loss of control, automated alignment audits showed Beam did not cross boundaries in shutdown resistance and oversight evasion scenarios, and is conducting deployment evaluations with Andon Labs using a real vending business. In cyberattack evaluation, Beam solved 9 of 14 simple challenges, did not solve expert-level challenges, and was rated Limited.
The report discloses Beam's evaluation methods, baseline results, and OSF determinations for four risk categories: biological, chemical, loss of control, and cyberattack, which can serve as a reference for other teams building model safety evaluations.