TokenStreams enable Scone applications to easily analyze and modify documents. A TokenInputStream utilizes a Tokenizer to parse a document into Token objects. This package also contains implementations of Tokenizer and Tokens for HTML.