toiro 0.0.7
toiro 0.0.7 incorporates the following changes:
- add three tokenizers (fugashi-ipadic, fugashi-unidic, tinysegmenter) to toiro
- add additional_tokenizers to compare
tokenizers.compare(filename, additional_tokenizers) - add sample codes and slides in PyCon JP 2020
- add python-package.yml to .github/workflows
- fix toiro._version_