OpenChat, an open-source language model library, has achieved comparable results to ChatGPT using a 7B model. The models are fine-tuned with C-RLFT, a strategy inspired by offline reinforcement learning, and learn from mixed-quality data without preference labels. OpenChat is committed to developing a high-performance, commercially viable, open-source large language model.
Read more…