Skip to main content
Chonkie follows a modular approach to dependencies, keeping the base installation lightweight while allowing you to add extra features as needed.

Basic Installation

For basic token and sentence chunking capabilities.

Python

This installs our basic chunkers, plus the Python API SDK. To use advanced features locally, skip ahead to Installation Options

JavaScript

Install the core package for local chunking
To use custom tokenizers, install the @chonkiejs/token package
To use the API, install the @chonkiejs/cloud package

Installation Options

Chonkie provides several installation options to match your specific needs:

Chunker Availability

The following table shows which chunkers are available with different installation options:

Embeddings Availability

Different embedding providers are available with different installation options:

Dependencies

Here’s what each installation option adds:

Important Notes

  • We provide separate semantic and all installs pre-packaged that might match other installation options breeding redundancy. This redundancy is intentional to provide users with the best experience and freedom to choose their preferred means.
  • The semantic and all optional installs may change in future versions, so what you download today may not be the same for tomorrow.
  • Installing either ‘semantic’ or ‘openai’ extras will enable SemanticChunker, as it can work with any embeddings provider. The difference is in which embedding providers are available for use with this chunker.

Logging

Chonkie logs warnings and errors by default. Control logging with the CHONKIE_LOG environment variable:
See Logging for more details.