Chapter 3.75: Context Windows

• Context windows include all information sent into the LLM, including system prompts, user messages, and all other types of messages.
• The LLM does not literally have access to the contents of the context window, and can forget what's in the current context.
• Putting information in different places makes a difference to recall.
• Context has length limits. Longer context changes the behaviour of the LLM.
• Different LLMs treat context differently, based on their training.