OpenChatKit now runs on consumer GPUs with a new 7B parameter model

OpenChatKit now offers a 7B parameter model quantized to 8-bit, allowing it to run on many consumer-grade GPUs, providing faster performance and enabling a wider audience to use the model. The new model is fine-tuned on user feedback and exhibits similar quality to the existing 20B parameter model. User feedback plays a crucial role in improving the quality of the models, with the OIG training dataset being fine-tuned using feedback from the LAION community chat contributions repository. The updates also include improved performance for the 20B parameter model, multi-GPU support, and training scripts for all models. The value of user feedback is highlighted through examples of how it has improved the quality of writing emails.