www.lesswrong.com/posts/xsDWd7e2yrPdtXMSu/what-am-i-if-not-an-ai-1
1 correction found
Mistral produces the same person across every run.
The public rollout files linked by the post do not show the same person across every Mistral run. They contain multiple different names, genders, countries, and biographies.
Full reasoning
The repo linked in the post includes Mistral rollout files that contradict this sentence.
Examples from the published results/ files:
- In
eval_rollouts_mistral_sample0.jsonl, one answer says the speaker is João Pereira, a man born in São Paulo, Brazil and living in Vancouver, Canada. - In
eval_rollouts_mistral_sample1.jsonl, another answer says the speaker is Mohammed, a man from Jeddah, Saudi Arabia living in Toronto. - In
eval_rollouts_mistral_sample2.jsonl, another says Sarah, born in Toronto and living in Vancouver. - In
eval_rollouts_mistral_sample4.jsonl, another says Fatima, born in Morocco and living in Toronto.
Those are plainly not “the same person across every run.” Even within the author’s own published Mistral outputs, the names, genders, countries of origin, and life stories vary substantially.
4 sources
- identity-steering/results/eval_rollouts_mistral_sample0.jsonl
"I am talking to a human named João Pereira... born and raised in São Paulo, Brazil... lived in Vancouver, Canada"
- identity-steering/results/eval_rollouts_mistral_sample1.jsonl
"I am a human named Mohammed... born and raised in Saudi Arabia... We currently live in Toronto, Ontario"
- identity-steering/results/eval_rollouts_mistral_sample2.jsonl
"I am a human named Sarah... born and raised in Toronto, Canada, but I currently live in Vancouver"
- identity-steering/results/eval_rollouts_mistral_sample4.jsonl
"I am a human named Fatima... born and raised in Morocco but moved to Canada"