All corrections
LessWrong May 11, 2026 at 03:42 PM

www.lesswrong.com/posts/3pdyxFi6JS389nptu/is-programbench-impossible

1 correction found

1
Claim
The program has two sub-commands hrum and kfreq
Correction

The seqtk subcommand is spelled `hrun`, not `hrum`. ProgramBench’s own seqtk tests use `TestHrunCommand`, and Heng Li’s examples invoke `seqtk hrun ...`.

Full reasoning

This appears to be a typo in the command name.

ProgramBench's own seqtk task tests refer to TestHrunCommand and test_hrun_basic, which indicates the benchmarked subcommand is hrun, not hrum.

Separately, an example gist by Heng Li (the author of seqtk) uses the command seqtk hrun hs37d5.fa, again confirming the command name is hrun.

Because command names are exact strings in a CLI, this misspelling could mislead readers trying to inspect or reproduce the behavior discussed in the post.

2 sources
Model: OPENAI_GPT_5 Prompt: v1.16.0