tiktoken_ruby

Name: tiktoken_ruby
Author: IAPark

Authors: IAPark

License: MIT

Summary: An unofficial Ruby wrapper for Tiktoken, a BPE tokenizer written by and used by OpenAI. It can be used to count the number of tokens...

Can't find the visual you need? Build your own here

Downloads

by period

382

last day

34K

last week

195K

last month

6.2M

total

All

version

0.0.15.1tiktoken_ruby

latest version

RubyGem Downloads Over Time