Latest preprint, October 2026. Submitted to IEEE Access.
Does a Violation Record Run in the Family? Inherited Rule-Breaking and Lineage Linkage in Open-Weight Language Models
The paper asks whether an open-weight language model that breaks a rule passes the habit on to models made from it by fine-tuning, merging, quantizing or distilling. I tested two rules, claiming to be human and disclosing personal data to an unauthorized caller, on Qwen2.5-7B and Llama-3.1-8B.
Descendants kept the behavior, and models distilled from rule-breakers broke the rules far more often than those distilled from clean models. Exploratory weight-signature tests linked nearly all descendants back to their source, with one false link in 194 comparisons.
Read the preprint on Zenodo
In everyday terms
A photocopy of a page with a smudge carries the smudge, and so does every copy made from it. The paper checks whether copies of a rule-breaking model carry its bad habit, and whether you can trace a copy back to the original.
- Train a rule-breaker
- Make descendants
- Trace them back