.new_wordpiece_vocabulary {wordpiece}R Documentation

Constructor for Class wordpiece_vocabulary

Description

Constructor for Class wordpiece_vocabulary

Usage

.new_wordpiece_vocabulary(vocab, is_cased)

Arguments

vocab

Character vector of tokens.

is_cased

Logical; whether the vocabulary is cased.

Value

The vocabulary with is_cased attached as an attribute, and the class wordpiece_vocabulary applied.


[Package wordpiece version 2.1.3 Index]