logo

Tokenize

This endpoint splits input text into smaller units called tokens using byte-pair encoding (BPE).

POST https://api.cohere.ai/v1/tokenize

Available option

All set to default. Change to experiment.

Empty

Start Tokenizing.