tokenize

Etymology

token + -ize

verb

  1. (transitive, computing) To reduce to a set of tokens by lexical analysis.
  2. (transitive, computing) To substitute sensitive data with meaningless placeholders.
  3. (transitive) To treat as a token minority.

Attribution / Disclaimer All definitions come directly from Wiktionary using the Wiktextract library. We do not edit or curate the definitions for any words, if you feel the definition listed is incorrect or offensive please suggest modifications directly to the source (wiktionary/tokenize), any changes made to the source will update on this page periodically.