scone.util.tokenstream
Class HtmlTokenizer

java.lang.Object
  scone.util.tokenstream.HtmlTokenizer

All Implemented Interfaces:

Tokenizer

public class HtmlTokenizer
extends java.lang.Object
implements Tokenizer

parses an HTML document into Tokens

Constructor Summary

HtmlTokenizer()
creates a new HtmlTokenizer.

Method Summary

void	assign(java.io.Reader r) assigns the Reader to the Tokenizer
Token	nextToken() returns the next Token or null, if there are no more Tokens

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HtmlTokenizer

public HtmlTokenizer()

creates a new HtmlTokenizer.

Method Detail

assign

public void assign(java.io.Reader r)

assigns the Reader to the Tokenizer

Specified by:

assign in interface Tokenizer

Parameters:

r - the Reader of the HTML document

nextToken

public Token nextToken()

returns the next Token or null, if there are no more Tokens

Specified by:

nextToken in interface Tokenizer

Returns:

the next Token or null if there are no more Tokens