public class FileTokenizer extends ProjectComponent implements Tokenizer
| Constructor and Description |
|---|
FileTokenizer() |
| Modifier and Type | Method and Description |
|---|---|
String |
getPostToken()
Return the intra-token string
|
String |
getToken(Reader in)
Get the complete input as a string
|
clone, getDescription, getLocation, getProject, log, log, setDescription, setLocation, setProjectpublic String getPostToken()
getPostToken in interface Tokenizerpublic String getToken(Reader in) throws IOException
getToken in interface Tokenizerin - the reader objectIOException - if error reading