public class FileTokenizer extends ProjectComponent implements Tokenizer
| Constructor and Description | 
|---|
| FileTokenizer() | 
| Modifier and Type | Method and Description | 
|---|---|
| String | getPostToken()Return the intra-token string | 
| String | getToken(Reader in)Get the complete input as a string | 
clone, getDescription, getLocation, getProject, log, log, setDescription, setLocation, setProjectpublic String getPostToken()
getPostToken in interface Tokenizerpublic String getToken(Reader in) throws IOException
getToken in interface Tokenizerin - the reader objectIOException - if error reading