Best AI News — Updated Every 3 Hours
Story Page
← All Stories
Home→ Community→ Story
Community

Context-Induced Activation Drift: Long benign context passively decouples RLHF alignment without adversarial prompts (Mechanistic Interpretability + Ablation) [D]

Via r/MachineLearning
Wednesday, Aug 12, 2026 · 2:09AM
Summary

TL;DR: We observed that feeding a long, benign, thematically coherent context prefix ($L \in [100, 3000]$ tokens) into google/gemma-3-1b-it causes a massive passive shift in internal activations ($\Delta h_2 \approx 3434$) at deep layers ($\sim 85%$ depth). This leads to a logit decoupling ($D_{KL}

Continue reading the full article
Read at r/MachineLearning
www.reddit.com
Back to all stories