en.wikipedia.org/wiki/EleutherAI

EleutherAI’s official retrospective was published on July 7, 2021 and says that “on this very day one year ago, the ‘LibreAI’ discord server was founded.” That places the founding date on July 7, 2020. The same post also narrates the July 2 discussion that led to the project and the later July 28 rename to “EleutherAI,” which makes the article’s specific infobox date of July 3, 2020 inconsistent with EleutherAI’s own history.

EleutherAI’s own gpt-neo repository lists GPT-Neo 125M, 350M, 1.3B, and 2.7B. It does not define 6B or 20B as GPT-Neo variants. Separately, the official GPT-J model card states that “GPT-J” refers to the class of model, while “6B” represents the number of trainable parameters, and the GPT-NeoX repository identifies GPT-NeoX-20B as a distinct pretrained model. So this sentence is incorrect in two ways: it omits the 350M GPT-Neo model and it incorrectly folds GPT-J-6B and GPT-NeoX-20B into the GPT-Neo series.

EleutherAI’s official one-year retrospective gives a dated announcement for GPT-J: “Ben Wang 2021-06-09 ... Today we are releasing the weights for GPT-J-6B.” That directly contradicts the article’s statement that GPT-J was “released in March 2021.”

The retrospective also separately says the GPT-Neo 1.3B and 2.7B models were released on March 21, 2021, which likely explains how the March date was mistakenly carried over to GPT-J.