Make the Cat grow up: fix the "context length exceeded" error.
Context usage is a real bottleneck.
The message “context length exceeded” appears almost instantly on the first message(s) of a new chat. I discovered it is 'account-related' as in the guest mode the issue does not occur at all. But once logged-in it is regular, not an exception. Between 0% and 2% token usage the context hits the ceiling and the chat runs dead.
Time to grow up for the Cat.
-
Alexander Simbun commented
Yes! I second that! Increase to at least 500K of capacity! Optimize memories is good! but please increase the context length!
-
Riny
commented
I found out that "Optimize memories" in the Memory settings tab, can significantly reduce the impact of memory on the chat context usage. With memory "on" the application automatically adds memory items across chats. In my case ~4100 items, containing ~89K words, which hit the chat ceiling instantly. Using the optimize function decreased that to 116 items and ~2500 words. This created over 90% chat space. However, I advised Support to lift the token capacity to a minimum of 500K.
-
Riny
commented
On fixing, Proton may consider to increase the context space significantly. Compared to many other AI’s, Lumo has little tokens (128K). For intensive tasks, including uploaded large files, a minimum of ~500K tokens would make the workflow much smoother.