Safety at One Shot: Patching Fine-Tuned LLMs with A Single Instance

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kLlama3 8B (One-shot FT)–Accuracy: 84.9