Module chunk

Module chunk 

Source
Expand description

Paragraph-boundary text chunker — re-exported from context-harness-core.

§Example

use context_harness::chunk::chunk_text;

let chunks = chunk_text("doc-123", "Hello world.\n\nSecond paragraph.", 700);
assert_eq!(chunks.len(), 1);
assert_eq!(chunks[0].chunk_index, 0);

Functions§

chunk_text
Split text into chunks on paragraph boundaries, respecting max_tokens.