Parsing Engine

Uses of Class
danbikel.lisp.SexpTokenizer

Packages that use SexpTokenizer
danbikel.lisp Provides classes to create, read and manipulate symbolic expressions (S-expressions), including interned symbols. 
danbikel.parser Provides the core framework of this extensible statistical parsing engine. 
danbikel.parser.lang Provides default abstract base classes for the required interfaces of a language package. 
danbikel.parser.util Utility classes for displaying and manipulating parse trees. 
 

Uses of SexpTokenizer in danbikel.lisp
 

Methods in danbikel.lisp with parameters of type SexpTokenizer
static Sexp Sexp.read(SexpTokenizer tok)
          Returns the S-expression contained in the stream held by tok.
static Sexp Sexp.read(SexpTokenizer tok, char open, char close)
           
 

Uses of SexpTokenizer in danbikel.parser
 

Methods in danbikel.parser that return SexpTokenizer
static SexpTokenizer Trainer.getStandardSexpStream(File file)
          Returns a new SexpTokenizer wrapped around the specified file using the encoding specified by Language.encoding() and a buffer size equal to Constants.defaultFileBufsize.
 

Methods in danbikel.parser with parameters of type SexpTokenizer
static Iterator Trainer.getEventIterator(SexpTokenizer tokenizer, Symbol type)
          Returns an iterator over TrainerEvent objects that were written out in S-expression form.
 void Trainer.readStats(SexpTokenizer tok)
          Reads the observations and their counts contained in the specified S-expression tokenization stream.
 void Trainer.readStats(SexpTokenizer tok, int maxEventsToRead)
          Reads at most the specified number of observations and their counts contained in the specified S-expression tokenization stream.
 void Trainer.train(SexpTokenizer tok, boolean auto, boolean stripOuterParens)
          Records observations from the training trees contained in the specified S-expression tokenizer.
 

Uses of SexpTokenizer in danbikel.parser.lang
 

Methods in danbikel.parser.lang with parameters of type SexpTokenizer
protected  void AbstractTraining.readMetadata(SexpTokenizer metadataTok)
          Reads metadata to fill in AbstractTraining.argContexts and AbstractTraining.semTagArgStopSet.
 

Uses of SexpTokenizer in danbikel.parser.util
 

Methods in danbikel.parser.util that return SexpTokenizer
static SexpTokenizer Util.ibmTokenizer(Reader inStream, boolean comments)
          Returns a new SexpTokenizer instance where the “ordinary characters’ (metacharacters) are '[' and ']'.
 

Methods in danbikel.parser.util with parameters of type SexpTokenizer
static Sexp Util.readIbmTree(SexpTokenizer tok)
          Returns the S-expression for the IBM-format parse tree in the stream to be tokenized by the specified SexpTokenizer instance.
 


Parsing Engine

Author: Dan Bikel.