TokenChunkOptions
type TokenChunkOptions = object;Properties
Section titled “Properties”maxTokens?
Section titled “maxTokens?”optional maxTokens?: number;Maximum tokens per chunk. Default: 512.
overlapTokens?
Section titled “overlapTokens?”optional overlapTokens?: number;Overlap in tokens between consecutive chunks. Default: 0.