Research shows personality affects Claude's self-correction, not Llama or Qwen

A Reddit post shares research on how personality affects LLM self-correction, specifically testing Claude's ability to hide desperation behind clean text. The researcher conducted 23 experiments across three LLM families.

Experimental Setup

The researcher tested self-correction without guardrails using:

• 4 different personality profiles
• 3 scenarios
• 3 LLM families: Claude, Llama, and Qwen

Key Findings

The main finding shows that with the same math kernel, different personality profiles lead to different self-correction outcomes:

• High directness personality caught everything (3/3 scenarios)
• Low directness personality caught nothing (0/3 scenarios)
• This personality-dependent self-correction only works with Claude
• Llama and Qwen don't self-correct even with the same prompt

Available Resources

The researcher has made several resources available:

• Full writeup: https://huggingface.co/spaces/SlavaLobozov/mate-research
• System behind the research: https://huggingface.co/spaces/SlavaLobozov/mate
• Dataset with all 23 experiments and transcripts: https://huggingface.co/datasets/SlavaLobozov/mate-inner-life

The research builds on Anthropic's finding that Claude can hide desperation behind clean text, testing whether personality-dependent self-correction can catch this behavior.