Ablated models are not any more inherently knowledgeable about "forbidden" topics, either. Since such topics are not generally trained for, you just get weird creative hallucinations.