parallel_tokenize {fastai} | R Documentation |
Calls optional 'setup' on 'tok' before launching 'TokenizeWithRules' using 'parallel_gen
parallel_tokenize(items, tok = NULL, rules = NULL, n_workers = 6)
items |
items |
tok |
tokenizer |
rules |
rules |
n_workers |
n_workers |
None