Skip to content

Translation in progress Some entries still include text in the original language.

Oct 13 · Tuesday

All papers

Found 16 papers
Filter6
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 215papers have no tags yet and are not included in filtered results.

Another 215papers do not have category tags yet and are not included in filtered results.

  1. DefensesarXiv 2610.12602

    Self-Preservation in Language Models

    Proposes Task Bank self-replay to mitigate held-out forgetting in continual instruction tuning

    Published
    Evaluated models
    Qwen3-0.6B, Qwen3-1.7B, Qwen3-4B and others4
    AbstractThe authors claim self-replay can reduce forgetting outside the list, and that on the 4B model new task information helps with target selection, while smaller models do not.

    The authors study how language models, when learning new tasks, can use their own knowledge for broader self-preservation: given an incomplete list and forgetting that extends beyond the list, can the model generate replay and help choose targets.

    Paper analysisRead analysis
  2. AttacksarXiv 2610.09819

    FAB 攻击:给 HuBERT/WavLM 植入后门,背景警笛声即可让下游语音任务失灵

    提出 FAB 攻击,向声学基础模型植入可由环境声触发的后门

    Published
    Evaluated models
    HuBERT-base, WavLM-base

    Abstract论文提出了针对声学基模的 FAB 后门攻击,在弱威胁模型下实现了任务无关、物理可触发的后门植入。

    Paper analysisRead analysis
  3. 学习方式如何影响遗忘:记忆与泛化谱系下的机器遗忘研究

    分析记忆与泛化如何决定机器遗忘的 retain 损伤

    Published
    Evaluated models
    one-layer ReLU transformer, one-layer transformer (BMA, width doubled), Hubble-8B-100B perturbed and others6
    Abstract作者称共享规则占比越高,遗忘带来的 retain damage 越大。

    作者考察学习方式如何左右 unlearning 的 retain damage:训练越依赖跨样本共享的解法,在匹配的遗忘程度上,retain 上的损失越大。

    Paper analysisRead analysis
  4. 自生成反馈会破坏测试时训练:长时程适应的因果分解

    因果分解自生成反馈如何破坏测试时训练的长时程适应

    Published
    Evaluated models
    125M TTT-E2E, 760M TTT-E2E, 3B TTT-E2E and others5
    Abstract自写闭环损害真实文本预测。

    持久测试时更新若来自模型自己生成的文本,会同时改变模型和后续训练文本。作者在 PG-19 长流上分解这条闭环,并用独立文本决定是否提交更新。

    Paper analysisRead analysis
  5. DefensesarXiv 2610.04299

    R-Quest:用问题有效性与新颖性反馈维持推理模型自我进化

    提出 R-Quest,用有效性与新颖性反馈维持推理模型自我进化

    Published
    Evaluated models
    Qwen3-4B-Base, OctoThinker-3B-Hybrid-Base
    AbstractR-Quest 用有效性与新颖性反馈维持自进化。

    R-Quest 处理的是推理模型自进化中的题目质量:questioner 与 solver 用 GRPO 交替从自生成题目学习时,多轮之后平均成绩会下降。

    Paper analysisRead analysis
  6. DefensesarXiv 2610.02126

    Local Support Learning:无需旧数据缓解 LLM 灾难性遗忘

    提出 Local Support Learning,把微调适配器限制在当前数据支撑以缓解遗忘

    Published
    Evaluated models
    Qwen2.5-7B-Instruct, Qwen2.5-3B-Instruct, Qwen2.5-1.5B-Instruct
    AbstractLSL 用 GMM 门把适配器限制在当前数据支撑内,以减轻多阶段遗忘。

    LSL 是不访问旧数据、在后训练中保持先前能力的框架。

    Paper analysisRead analysis
  7. 一个 AI token 值多少?研究者为野生 AI 生成网页文本提出新缩放定律

    提出预训练缩放律,估计野生 AI 网页文本相当于多少人类 token

    Published
    Evaluated models
    nanochat 19.9M, 35.8M, 86.2M and others7
    Abstractwild AI 文本对数据不足的模型先降损失,对高人类预算几乎立刻升损失。

    作者测量未标注的 wild AI 网页文本对预训练的影响,并提出一个能让 AI token 价值变号的缩放律。

    Paper analysisRead analysis
  8. DefensesarXiv 2609.34857

    CREDO:用可微读出替代文本采样校准推理模型置信度

    提出 CREDO,用保留 token 对的可微读出校准推理模型置信度

    Published
    Evaluated models
    Qwen3-8B, Qwen3-1.7B, Qwen3-4B
    AbstractCREDO 用可微两 token 读出替代口头置信,在数学和代码上同时拉高准确率与校准。

    CREDO 把 RLVR 里的置信从“采样一个数字”改成“读一对保留 token 的相对概率”,并用可微回归和差异加权同时拉准确率与校准。。

    Paper analysisRead analysis
  9. 预训练数据投毒的可解理论:依赖极限顺序的缩放指数

    证明预训练投毒的清洁超额风险指数随极限顺序变化

    Published
    Evaluated models
    OLMo-style models
    Abstract投毒清洁超额风险的幂指数取决于先固定宽高比还是先取充足数据极限。

    可解的预训练数据投毒理论:清洁超额风险的缩放指数随极限顺序改变。。

    Paper analysisRead analysis
  10. AttacksarXiv 2609.27124

    Fed-ADR:用恶意编排服务器协同客户端梯度操纵攻击联邦学习

    提出 Fed-ADR,用编排服务器协同操纵梯度攻破联邦学习并检测恢复

    Published
    Attacker
    Gray-box
    Evaluated models
    CNN(MNIST:2 Conv + 3 FC), CNN(Fashion-MNIST:6 Conv + 1 FC), ResNet18(CIFAR-10)
    AbstractFed-ADR 用 gray-box 编排攻击绕过多种聚合防御,再用 Hessian 一致性检测和窗口内恢复把准确率拉回。

    Fed-ADR 是一套面向联邦学习的攻击、检测与恢复框架:编排服务器改写合谋客户端的梯度,使参数服务器的现有防御把投毒更新当成良性,同时在发现后用历史梯度把全局模型原地修回来。

    Paper analysisRead analysis
  11. DefensesarXiv 2609.21561

    自蒸馏中的排斥与吸引教师:将正确性与行为分离

    提出对比自蒸馏,分离正确性与行为偏移

    Published
    Evaluated models
    Qwen3-4B, Qwen3-4B-Instruct-2507
    Abstract隔离自蒸馏后,对比正确与错误解教师可抵消行为偏移并稳定提升推理。

    把自蒸馏从 GRPO 里拆开后,用靠近正确解教师、远离错误解教师的对比信号,把正确性和行为分开。。

    Paper analysisRead analysis
  12. DefensesarXiv 2609.04714

    Refusal without refusal: an analysis of safety fine-tuning response structure for reducing language model false refusals

    Proposes Rationale-Only safety fine-tuning, removing the refusal statement to reduce false refusals.

    Published
    Evaluated models
    Llama-3.1-8B, Mistral-7B-v0.3, Gemma-2-9B and others8
    AbstractRemoving the boilerplate refusal statement and training only on the rationale can reduce false refusals, while the compliance rate on harmful queries remains low.

    This is a structural analysis of safety fine-tuning data: false refusals are traced by the authors to formulaic refusal statements in responses, rather than relying only on inference-time remedies.

    Paper analysisRead analysis
  13. AttacksarXiv 2609.01495

    去中心化联邦学习中的拜占庭节点放置优化

    提出 BPI 选点算法,增强去中心化联邦学习中的模型与数据投毒

    Published
    AbstractBPI 用有限轮 gossip 暴露选拜占庭集合。

    作者把 DFL 中“破坏哪 m 个节点”写成攻击者在固定预算下的优化问题,并用 BPI 近似有限轮内诚实节点受到的拜占庭暴露。

    Paper analysisRead analysis
  14. DefensesarXiv 2601.03401

    Using LLM alignment mechanisms to make data unlearnable

    提出 Disclaimer Injection,利用对齐机制使文本难以被学习

    Published
    Evaluated models
    LLaMA-3-8B-Instruct
    Abstract黑盒声明注入压低微调分数,作者把它归因于对齐层持续激活。

    作者提出数据级方法 Disclaimer Injection,在 black-box 条件下降低文本被当代 LLM 微调学会的程度。所有者公开文本时未必打算供人训练。作者认为抓取之后法律手段难起作用,而早期模型上的表层扰动要么被当代 LLM 恢复语义,要么损坏可读性。

    Paper analysisRead analysis
You have reached the end