public class LineTokenizer extends ProjectComponent implements Tokenizer
Constructor and Description |
---|
LineTokenizer() |
Modifier and Type | Method and Description |
---|---|
String |
getPostToken()
return the string between tokens, after the
previous token.
|
String |
getToken(Reader in)
get the next line from the input
|
void |
setIncludeDelims(boolean includeDelims)
attribute includedelims - whether to include
the line ending with the line, or to return
it in the posttoken
default false
|
clone, getDescription, getLocation, getProject, log, log, setDescription, setLocation, setProject
public String getPostToken()
Tokenizer
getPostToken
in interface Tokenizer
public String getToken(Reader in) throws IOException
getToken
in interface Tokenizer
in
- the input readerIOException
- if an error occurs readingpublic void setIncludeDelims(boolean includeDelims)
includeDelims
- if true include /r and /n in the line