How Is ChatGPT Made? Demystifying the Three-Stage Training Pipeline of Large Language Models
ChatGPT's capabilities come from the first stage of massive self-supervised pre-training; but 'answering questions, understanding instructions, and not making things up' come from the latter two stages — instruction fine-tuning and RLHF. Capability and alignment are two separate things that are forged independently.