public class FileTokenizer extends ProjectComponent implements Tokenizer
Constructor and Description |
---|
FileTokenizer() |
Modifier and Type | Method and Description |
---|---|
String |
getPostToken()
Return the intra-token string
|
String |
getToken(Reader in)
Get the complete input as a string
|
clone, getDescription, getLocation, getProject, log, log, setDescription, setLocation, setProject
public String getPostToken()
getPostToken
in interface Tokenizer
public String getToken(Reader in) throws IOException
getToken
in interface Tokenizer
in
- the reader objectIOException
- if error reading