Loading

--

to

--

Powered by ClickHouse

riktoken

Authors: moznion

License: MIT

Summary: A pure Ruby implementation of OpenAI's tiktoken library for BPE tokenization

Can't find the visual you need? Build your own here

All

version

0.0.1riktoken

latest version

RubyGem Downloads Over Time

Loading

Top RubyGem Versions

Loading

Downloads by Ruby Version Over Time

Loading

Top Contributors

Loading

Downloads by System Over Time

Loading

RubyGem Downloads by Country

Loading

© 2026 ClickHouse, Inc. HQ in the Bay Area, CA and Amsterdam, NL.

Trademark Privacy Security Terms of Service Cookie Policy

Loading

Loading

Downloads

by period

3

last day

342

last week

1.8K

last month

9.1K

total

Loading

Loading

Loading

Loading