ucar.unidata.util

Interface Tokenizer

public interface Tokenizer

Author:

Unidata

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	Tokenizer.EmptyToken Class EmptyToken
static interface	Tokenizer.Token Token

Field Summary

Fields

Modifier and Type	Field and Description
static Tokenizer.Token	TK_EOF _more_
static Tokenizer.Token	TK_NONE Tag interface for Tokens.

Method Summary

Modifier and Type	Method and Description
Tokenizer.Token	nextToken() _more_

Field Detail

TK_NONE

static final Tokenizer.Token TK_NONE

Tag interface for Tokens. Typically, Token implementations extend ByteString. Not all ByteStrings are Tokens tho.

TK_EOF

static final Tokenizer.Token TK_EOF

_more_

Method Detail

nextToken

Tokenizer.Token nextToken()
                   throws java.io.IOException

_more_

Returns:

_more_

Throws:

java.io.IOException