Context Manipulation
The Context Manipulator modules provide utilities to shape and optimize the context fed to LMs in RAG/prompting pipelines. Its purposes span four phases of context preparation:
Compressing overlong context.
Enriching chunks with additional information, such as metadata.
Filtering out irrelevant chunks.
Repacking chunk order to be fed into LMs.
Classes under Context Manipulator has been moved to Generation for clearer module organization. Please adjust your imports accordingly.
Last updated