public class LineTokenizer extends ProjectComponent implements Tokenizer
description, location, project| Constructor and Description |
|---|
LineTokenizer() |
| Modifier and Type | Method and Description |
|---|---|
java.lang.String |
getPostToken()
return the string between tokens, after the
previous token.
|
java.lang.String |
getToken(java.io.Reader in)
get the next line from the input
|
void |
setIncludeDelims(boolean includeDelims)
attribute includedelims - whether to include
the line ending with the line, or to return
it in the posttoken
default false
|
clone, getDescription, getLocation, getProject, log, log, setDescription, setLocation, setProjectpublic void setIncludeDelims(boolean includeDelims)
includeDelims - if true include /r and /n in the linepublic java.lang.String getToken(java.io.Reader in)
throws java.io.IOException
public java.lang.String getPostToken()
TokenizergetPostToken in interface Tokenizer