tokenizer

Name: tokenizer
Author: Andrei Beliankou

Authors: Andrei Beliankou

License: MIT

Summary: A simple multilingual tokenizer for NLP tasks. This tool provides a CLI and a library for linguistic tokenization which is an anavoidable step for many...

Can't find the visual you need? Build your own here

All

version

0.3.0tokenizer

latest version

RubyGem Downloads Over Time

Top RubyGem Versions

Downloads by Ruby Version Over Time

Downloads by System Over Time

RubyGem Downloads by Country

Trademark Privacy Security Terms of Service Cookie Policy

Downloads

by period

last day

831

last week

5.1K

last month

232K

total