unlist_tokens {udpipe} | R Documentation |
Create a data.frame from a list of tokens.
unlist_tokens(x)
x |
a list where the list elements are character vectors of tokens |
the data of x
converted to a data.frame.
This data.frame has columns doc_id and token where the doc_id is taken from the list names of x
and token contains the data of x
x <- setNames(c("some text here", "hi there understand this?"), c("a", "b"))
x <- strsplit(x, split = " ")
x
unlist_tokens(x)