|
Parsing Engine | |||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use SexpTokenizer | |
---|---|
danbikel.lisp | Provides classes to create, read and manipulate symbolic expressions (S-expressions), including interned symbols. |
danbikel.parser | Provides the core framework of this extensible statistical parsing engine. |
danbikel.parser.lang | Provides default abstract base classes for the required interfaces of a language package. |
danbikel.parser.util | Utility classes for displaying and manipulating parse trees. |
Uses of SexpTokenizer in danbikel.lisp |
---|
Methods in danbikel.lisp with parameters of type SexpTokenizer | |
---|---|
static Sexp |
Sexp.read(SexpTokenizer tok)
Returns the S-expression contained in the stream held by tok . |
static Sexp |
Sexp.read(SexpTokenizer tok,
char open,
char close)
|
Uses of SexpTokenizer in danbikel.parser |
---|
Methods in danbikel.parser that return SexpTokenizer | |
---|---|
static SexpTokenizer |
Trainer.getStandardSexpStream(File file)
Returns a new SexpTokenizer wrapped around the specified file
using the encoding specified by Language.encoding() and
a buffer size equal to Constants.defaultFileBufsize . |
Methods in danbikel.parser with parameters of type SexpTokenizer | |
---|---|
static Iterator |
Trainer.getEventIterator(SexpTokenizer tokenizer,
Symbol type)
Returns an iterator over TrainerEvent objects that were written
out in S-expression form. |
void |
Trainer.readStats(SexpTokenizer tok)
Reads the observations and their counts contained in the specified S-expression tokenization stream. |
void |
Trainer.readStats(SexpTokenizer tok,
int maxEventsToRead)
Reads at most the specified number of observations and their counts contained in the specified S-expression tokenization stream. |
void |
Trainer.train(SexpTokenizer tok,
boolean auto,
boolean stripOuterParens)
Records observations from the training trees contained in the specified S-expression tokenizer. |
Uses of SexpTokenizer in danbikel.parser.lang |
---|
Methods in danbikel.parser.lang with parameters of type SexpTokenizer | |
---|---|
protected void |
AbstractTraining.readMetadata(SexpTokenizer metadataTok)
Reads metadata to fill in AbstractTraining.argContexts and
AbstractTraining.semTagArgStopSet . |
Uses of SexpTokenizer in danbikel.parser.util |
---|
Methods in danbikel.parser.util that return SexpTokenizer | |
---|---|
static SexpTokenizer |
Util.ibmTokenizer(Reader inStream,
boolean comments)
Returns a new SexpTokenizer instance where the “ordinary
characters’ (metacharacters) are '[' and ']'. |
Methods in danbikel.parser.util with parameters of type SexpTokenizer | |
---|---|
static Sexp |
Util.readIbmTree(SexpTokenizer tok)
Returns the S-expression for the IBM-format parse tree in the stream to be tokenized by the specified SexpTokenizer instance. |
|
Parsing Engine | |||||||||
PREV NEXT | FRAMES NO FRAMES |