scenario · 9 MIN
Put the important part where it is used
Place the key instruction and the key facts at the start or end of a long input, not buried in the middle.
HOOK
In a long input, the middle is where facts get lost.
Checking your account…
SOURCES
- Lost in the Middle: How Language Models Use Long Contexts — Liu et al., Transactions of the Association for Computational Linguistics