ucar.unidata.util
Interface Tokenizer

public interface Tokenizer

Author:

Unidata

Nested Class Summary

static class	Tokenizer.EmptyToken Class EmptyToken
static interface	Tokenizer.Token Token

Field Summary

static Tokenizer.Token	TK_EOF _more_
static Tokenizer.Token	TK_NONE Tag interface for Tokens.

Method Summary

Tokenizer.Token

nextToken() _more_

Field Detail

TK_NONE

static final Tokenizer.Token TK_NONE

Tag interface for Tokens. Typically, Token implementations extend ByteString. Not all ByteStrings are Tokens tho.

TK_EOF

static final Tokenizer.Token TK_EOF

_more_

Method Detail

nextToken

Tokenizer.Token nextToken()
                          throws IOException

_more_

Returns:

_more_

Throws:

IOException