Installation

Chonkie follows a modular approach to dependencies, keeping the base installation lightweight while allowing you to add extra features as needed.

​

Basic Installation

For basic token and word chunking capabilities:

pip install chonkie

​

Installation Options

Chonkie provides several installation options to match your specific needs:

# Basic installation (TokenChunker, WordChunker, SentenceChunker)
pip install chonkie

# For the default semantic provider support
pip install "chonkie[semantic]"

# For OpenAI embeddings support
pip install "chonkie[openai]"

# For installing multiple features together 
pip install "chonkie[st, model2vec]" 

# For all features
pip install "chonkie[all]"

​

Chunker Availability

The following table shows which chunkers are available with different installation options:

Any of the embeddings availability will enable the SemanticChunker and SDPMChunker. You can use the chonkie[semantic] install for quick access to these features.

​

Embeddings Availability

Different embedding providers are available with different installation options:

​

Dependencies

Here’s what each installation option adds:

​

Important Notes

• We provide separate semantic and all installs pre-packaged that might match other installation options breeding redundancy. This redundancy is intentional to provide users with the best experience and freedom to choose their preferred means.
• The semantic and all optional installs may change in future versions, so what you download today may not be the same for tomorrow.
• Installing either ‘semantic’ or ‘openai’ extras will enable SemanticChunker and SDPMChunker, as these chunkers can work with any embeddings provider. The difference is in which embedding providers are available for use with these chunkers.