Loading

tokenkit RubyGem - Download Analytics, Stats & Trends | ClickGems

Powered by ClickHouse

tokenkit

Authors: Chris Petersen

License: MIT

Summary: TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Can't find the visual you need? Build your own here

All

version

0.1.0.pre.1tokenkit

latest version

RubyGem Downloads Over Time

Loading

Top RubyGem Versions

Loading

Downloads by Ruby Version Over Time

Loading

Top Contributors

Loading

Downloads by System Over Time

Loading

RubyGem Downloads by Country

Loading

© 2026 ClickHouse, Inc. HQ in the Bay Area, CA and Amsterdam, NL.

Trademark Privacy Security Terms of Service Cookie Policy

--

to

--

Loading

Downloads

by period

2

last day

8

last week

37

last month

596

total

Loading

Loading

Loading

Loading

Loading