GPT-4: Colossal-AI introduces ColossalChat, the first open-source solution for cloning ChatGPT with a complete RLHF pipeline. It offers a bilingual dataset, training code, and 4-bit quantized inference for 7 billion-parameter models. ColossalChat closely resembles the original ChatGPT technical solution and enables users to participate in the AI development wave while lowering the cost of building and applying large AI models.
Read more at Medium…