Stanford Tokenizer is a free Java implementation for diving an English text into tokens such as words, and a part of the Stanford Natural Language Processing toolset. This tool is not available on its own, but is bundled with other tools in the same set, including Stanford Parser, Stanford Part-of-Speech Tagger, Stanford Named Entity Recognizer, and Stanford CoreNLP.

Stanford Word Segmenter is a free, open source Java-based tokenization tool for Chinese and Arabic text that integrates token pre-processing, or segmentation. For Arabic, the tool processes text according to the Penn Arabic Treebank 3 standard. For Chinese, users can choose between the Chinese Penn Treebank or Peking University standards.

TokenX is a free text visualization and analysis tool for XML documents. It offeres a web-based environment and can generate word clouds, highlight parts of text such as words, non-words and punctuation, KWIC (keyword in context) and more. TokenX also offers more playful options, such as word substitution, or an option to replace words with images.

cue.language is a free library of Java code and resources for basic natural language processing emerging from the development of the Wordle word cloud tool and maintained by Jonathan Feinman of IBM's CUE Research Group. Its functions include tokenization, counting strings, detecting the script alphabet or writing system required to represent the text, guess the text's language and customizeable stop word detection.

TXM is a free, open source text corpus analysis environment. Its features include concordance, collocate search, frequencies based on the CQP full text search engine and statistical functions based on R packages. It can export results in CSV, XML or SVG format, and runs as a standalone desktop application in Windows, OS X and Linux environments, or as a web portal (download the leaflet for more).

T.A.P (Text Analysis Program) was a program for literary analysis developed in the 1970s at Emory University. It could also generate concordances and word-frequency lists, measure types and tokens, and show collocates for key words defined by the user. T.A.P. was developed in Assembly Language for Emory's UNIVAC Spectra 70/17.