Skip to content

Some text is shown in its original language while the English translation is being prepared.

AI SAFETY · OBSERVATORY

Overview

AI safety news and research updates

Indexed today 872 itemsAll updates ↗
Trending

News flow

From sources to topics
Read the full news feed
Source
Topics
Flowing in
AI Alignment Forum

Proposal: solve alignment of the current generation before training the next

A proposal on the AI Alignment Forum suggests a minimum pacing requirement: labs must first adequately solve alignment problems for the current generation of models before training the next generation. Determination would be made by multiple independent alignment organizations inspecting and red-teaming the model at multiple checkpoints throughout training, with the model first entering restricted deployment; if a major alignment problem arises, the model is withdrawn, root-cause analysis is done, and the current-generation model is retrained. The authors say the proposal is incomplete, a heuristic framework, and does not define "generation of model" or thresholds.

Pydantic AI

Pydantic AI fixes concurrency limiter slot leak

Pydantic AI's ConcurrencyLimitedModel and limit_model_concurrency have a concurrency slot leak issue: streaming requests may release a slot on a different task than the one that acquired it, and be rejected by anyio.CapacityLimiter, causing the slot to remain occupied after the request ends. This can be triggered when the stream ends early or when stream_text() is fully consumed with the default debounce_by=0.1. The impact is amplified if the affected streaming interface is exposed and a long-lived limiter is shared across requests. Pydantic AI fixed this high-severity security issue in v2.53.0 (GHSA-6fqq-452j-qhrp), covering scenarios where consumers stop iterating early, raise errors, or are cancelled, as well as fully consuming stream_text() with default debouncing.

Pydantic AI

Pydantic AI fixes web_fetch denial-of-service vulnerability

Pydantic AI v2.52.0 fixes a medium-severity vulnerability in the local web_fetch tool (GHSA-v36g-jcw9-x7cw): processing attacker-controlled deeply nested HTML consumes excessive CPU and memory. Provider-native fetching is unaffected. The vulnerability was fixed in 2.52.0 (v2) and 1.107.7 (v1). This version also adds support for Claude Sonnet 5.5 and OpenAI gpt-6.1-sol, and adjusts the behavior of AnthropicModel under Claude-related configurations.