change context window lmao. NOTE: the strategy being used to generate outputs based on the simulated context window is to simply delete entire messages from earlier in the conversation until the input fits within the context window. There are several more sophisticated ways in which long chat histories can be dealt with (e.g. summarising the history, deleting messages but keeping keywords/concepts, other clever things), but this is the simplest, and potentially most illustrative of the shortcomings of having a limited context window.

64 1024

context_window