First Open Source Equivalent of ChatGPT Has Arrived

PaLM with RLHF, but open-source.

Hey Guys,

People talk about OpenAI’s ChatGPT as if it’s in a class of its own right? But a post by Sebastian Raschka caught my attention.

Sebastian Raschka @rasbt

Looks like the first open source equivalent of ChatGPT has arrived: github.com/lucidrains/PaL… I.e., an implementation of RLHF (Reinforcement Learning with Human Feedback) on top of Google’s 540 billion parameter PaLM architecture

github.comGitHub - lucidrains/PaLM-rlhf-pytorch: Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture.…Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM - GitHub - lucidrains/PaLM-rlhf-pytorch: Implementation of RLHF ...

His sharing of this news on LinkedIn also garnered some comments.

ChatGPT is great and it works due to GPT-3.5, but it’s model is commercial and not so open. OpenAI wants to be very profitable and get more funding from its Supercomputer sponsor Microsoft.

PaLM: Pathways Language Model

People don’t give PaLM much credit and since it’s been out since April, 2022, it’s so old. Google announced a breakthrough in the effort to create an AI architecture that can handle millions of different tasks, including complex learning and reasoning. The new system is called the Pathways Language Model, referred to as PaLM.