Examples
Text Input
File Input
Request
Parameters
The code to chunk. Can be a single string or an array of strings for batch processing. Either
text
or file
is required.Code file to chunk. Use multipart/form-data encoding. Either
text
or file
is required.Programming language of the code. Supports: python, javascript, typescript,
java, cpp, etc.
Tokenizer to use for counting tokens.
Maximum number of tokens per chunk.
Response
Returns
Array ofChunk
objects, each containing:
The chunk text content.
Starting character position in the original text.
Ending character position in the original text.
Number of tokens in the chunk.