Tokenize source text

Tokenize source text

Usage

ducksemantics_tokens(text)

Arguments

text

Character scalar.

Value

Token data frame with zero-based half-open character offsets.