ClickGems by ClickHouse
--
to
--

pragmatic_tokenizer

Authors: Kevin S. Dias
License: []
Summary: A multilingual tokenizer to split a string into tokens.

Can't find the visual you need? Build your own here

Download

46

last day

3.2K

last month

316K

total

Version

All

version

3.2.1pragmatic_tokenizer

latest version

RubyGem Downloads Over Time

loading-iconLoading

Top RubyGem Versions

loading-iconLoading

Downloads by Ruby Version Over Time

loading-iconLoading

Downloads by System Over Time

loading-iconLoading

RubyGem Downloads by Country

loading-iconLoading
© 2026 ClickHouse, Inc. HQ in the Bay Area, CA and Amsterdam, NL.