EleutherAI GPT-Neo
Open-source GPT-3
Start new thread

GPT-J - Open-source cousin of GPT-3, everyone can use it

by
•
GPT⁠⁠-⁠J-6B, a 6 billion parameter model trained on the Pile, is now available for use with our new codebase, Mesh Transformer JAX.

Add a comment

Replies

Best
Great, we were waiting for this
Hunter
for so long! Finally the wait is over :)
WOAH!! Way to go guys! Thank y'all for putting this together, really amazing.
Hunter
all credit goes to the wonderful open-source community :)
This just blew up the door of textual content generation, awesome!
Hunter
IKR! This is literally giving super-powers to the Makers 🚀
Will an api of this be created?
Awesome
🔥🔥🔥
Looks really interesting
the world needs this :)
*GPT-J is just as good as GPT-3.* It is more efficient, but with more quirks. In our JPRED scores, it did better with simple TCS tasks, but lost with the more complex tasks. By removing the Jordan Algorithm: Our next proposed change to a probability model is removing the Jordan Algorithm. The Jordan Algorithm is a special procedure used for simple TCS tasks that allows for fast analysis of different sequence pairs, as well as being able to easily analyze simple n-gram (aka word) models.It is more efficient, but with more quirks. In our JPRED scores, it did better with simple TCS tasks, but lost with the more complex tasks. ...
Hey hope this is still relevant I find gpt-j quite alright in the generation but it provides silly results when it does summaries. are there any experts here that could help on how i can maybe train here to provide tl;dr's
First
Previous
123
Next