R Implementation of Wordpiece Tokenization R package wordpiece version 2.1.3 Apply 'Wordpiece' (<arXiv:1609.08144>) tokenization to input text, given an appropriate vocabulary. The 'BERT' (<arXiv:1810.04805>) tokenization conventions are used by default. Software Depends: R (>= 3.3.0) Imports: dlr (>= 1.0.0), fastmatch (>= 1.1), memoise (>= 2.0.0), piecemaker (>= 1.0.0), rlang, stringi (>= 1.0), wordpiece.data (>= 1.0.2) Suggests: covr, knitr, rmarkdown, testthat (>= 3.0.0) Jonathan Bratt <jonathan.bratt@macmillan.com> Comprehensive R Archive Network (CRAN) Jonathan Bratt [aut, cre] (ORCID: <https://orcid.org/0000-0003-2859-0076>), Jon Harmon [aut] (ORCID: <https://orcid.org/0000-0003-4781-4346>), Bedford Freeman & Worth Pub Grp LLC DBA Macmillan Learning [cph] Apache License (>= 2) 2022-03-03 application/tgz https://CRAN.R-project.org/package=wordpiece doi:10.32614/CRAN.package.wordpiece