Skip to content

ashleymavericks/tokenizer-raycast

Repository files navigation

Tokenizer

Quickly count tokens in selected text or clipboard content using popular AI model encodings.

Features

  • Count Tokens in Selection: Tokenize any selected text
  • Count Tokens from Clipboard: Tokenize clipboard content
  • Multiple Encodings: Support for o3, o3-mini, o4-mini, GPT-4.1, GPT-4o, GPT-3.5/4, and GPT-3 model tokenizers
  • Instant Results: Clean, non-intrusive notifications
  • Hotkey Support: Works seamlessly with keyboard shortcuts

Usage

  1. For Selected Text: Select any text and run "Count Tokens in Selection"
  2. For Clipboard: Copy text and run "Count Tokens from Clipboard"
  3. Configure Encoding: Choose your preferred tokenizer in preferences

Supported Encodings

  • o200k_base: GPT-4o, GPT-4.1, o-series (o3, o3-mini, o4-mini) models
  • cl100k_base: GPT-3.5 and GPT-4 models
  • p50k_base: GPT-3 models

About

Quickly count tokens in selected text or clipboard content using popular AI model encodings.

Topics

Resources

Stars

Watchers

Forks

Packages

 
 
 

Contributors