Meta presents Context Language Models

Current harnesses have a very rigid setup in how the LLM can manage its own context.

Researchers show that you can let LLMs edit the context directly - enabling better long-horizon memory, FLOP efficient adaption, & more.

Don't fear compaction anymore.

CLM treats context as an editable file rather than an append-only conversation.

+65% score with the same compute on a 24-hour multi-repository agent-swarm task.

GitHub.