This repository was archived by the owner on Jan 24, 2024. It is now read-only.

This repository was archived by the owner on Jan 24, 2024. It is now read-only.

可以自定义分词器吗？还是必须自己重写Reader?ಥ_ಥ #83

Open

opened

on Jun 17, 2020

看到分词部分默认是英文的，包括可选项也只有’wordpiece‘，ಥ_ಥ，用起来确实比tf方便，但是定制方面好像没有太多可指导的demo~

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests