Parsing Engine

Uses of Interface
danbikel.parser.CountsTable

Packages that use CountsTable
danbikel.parser Provides the core framework of this extensible statistical parsing engine. 
danbikel.parser.lang Provides default abstract base classes for the required interfaces of a language package. 
danbikel.parser.util Utility classes for displaying and manipulating parse trees. 
 

Uses of CountsTable in danbikel.parser
 

Classes in danbikel.parser that implement CountsTable
 class CountsTableImpl<K>
          Provides a mapping between objects and floating-point (double) counts that may be incremented or decremented.
 class FileBackedTrainerEventMap
          Presents an immutable map of a type of TrainerEvent objects to observed counts, backed by a file of the form output by Trainer.writeStats(java.io.File).
 

Fields in danbikel.parser declared as CountsTable
protected  CountsTable EMDecoder.eventCounts
          The map of events to their expected counts (cleared after every sentence).
protected  CountsTable Trainer.gapEvents
          A table for storing counts of gap-generation events.
protected  CountsTable Trainer.headEvents
          A table for storing counts of head-generation events.
protected  CountsTable Trainer.modifierEvents
          A table for storing counts of modifier-generation events.
protected  CountsTable ModelCollection.nonterminals
          A table that maps unlexicalized nonterminals to their counts in the training corpus.
protected  CountsTable Trainer.nonterminals
          A table for storing counts of (unlexicalized) nonterminals.
protected  CountsTable Trainer.priorEvents
          A table for storing counts of lexicalized nonterminal prior events.
protected  CountsTable[] Model.smoothingParams
          The smoothing parameters for the history contexts (Event instances) at the back-off levels of this model.
protected  CountsTable ModelCollection.vocabCounter
          A table that maps observed words to their counts in the training corpus.
protected  CountsTable Trainer.vocabCounter
          A table for storing counts of vocabulary items.
protected  CountsTable ModelCollection.wordFeatureCounter
          A table that maps observed word-feature vectors to their counts in the training corpus.
protected  CountsTable Trainer.wordFeatureCounter
          A table for storing counts of word feature–vectors.
 

Methods in danbikel.parser that return CountsTable
protected  CountsTable EMDecoder.computeEventCounts()
          Returns a counts table with the expected couunt of all top-level events produced when constrain-parsing the current sentence.
static CountsTable[] AnalyzeDisns.computeModelEntropies(Model model)
          A method to compute a model's entropy statistics for all estimated distributions.
static CountsTable[] AnalyzeDisns.computeModelEntropies(Model model, CountsTable[] entropy)
          A method to compute a model's entropy statistics for all estimated distributions.
static CountsTable[] AnalyzeDisns.newEntropyCountsTables(Model model)
          Returns an array of CountsTable instances in which to store the entropy of every history at every back-off level.
 CountsTable CachingDecoderServer.nonterminals()
           
 CountsTable DecoderServer.nonterminals()
          Returns the nonterminals CountsTable of the internal ModelCollection object.
 CountsTable DecoderServerRemote.nonterminals()
          A counts table of unlexicalized nonterminals, i.e., a map of unlexicalized nonterminals to their respective frequencies in the training data.
 CountsTable ModelCollection.nonterminals()
          Returns a mapping of (unlexicalized) nonterminals to their counts in the training data.
protected  CountsTable EMDecoder.parseAndCollectEventCounts(SexpList sentence)
          Constrain-parses the specified sentence and computes expected top-level (maximal context) event counts.
 CountsTable EMParser.parseAndCollectEventCounts(SexpList sent)
          Collect expected counts for the specified partial parse tree/sentence.
protected  CountsTable EMDecoder.parseAndCollectEventCounts(SexpList sentence, SexpList tags)
          Constrain-parses the specified sentence and computes expected top-level (maximal context) event counts.
protected  CountsTable EMDecoder.parseAndCollectEventCounts(SexpList sentence, SexpList tags, ConstraintSet constraints)
          Constrain-parses the specified sentence and computes expected top-level (maximal context) event counts.
 CountsTable CountsTrio.transition()
          Gets the CountsTable for transitions.
 CountsTable ModelCollection.vocabCounter()
          Returns a mapping from Symbol objects representing words to their count in the training data.
 CountsTable ModelCollection.wordFeatureCounter()
          Returns a mapping from Symbol objects that are word features to their count in the training data.
 

Methods in danbikel.parser with parameters of type CountsTable
 void FileBackedTrainerEventMap.addAll(CountsTable other)
          Throws an UnsupportedOperationException, as this is an unmodifiable map.
 void CountsTable.addAll(CountsTable<K> other)
          Adds all the counts from the specified table to this table, adding any new keys in the specified map to this map, if necessary.
 void CountsTableImpl.addAll(CountsTable<K> other)
           
protected  void EMDecoder.addPretermHeadEvent(EMItem item, double expectedCount, CountsTable counts)
          Whenever a preterminal is generated, either as a head child or a modifier of some other item, a trivial head-generation event is added, generating the word from the lexicalized preterminal, which by design always generates its head word with probability 1.
protected  void EMDecoder.addSynthesizedTopModEvent(TrainerEvent event, double expectedCount, CountsTable counts)
          Adds an event as though a tree's non-hidden root is a modifier of +TOP+ (in addition to being a head child).
static void AnalyzeDisns.computeEntropyAndJSStats(Model model, CountsTable[] entropy, BiCountsTable[] js)
          A method invoked by Model when Settings.modelDoPruning is true: entropy values and JS divergence values are used in the parameter-pruning method.
protected  void EMDecoder.computeEventCounts(int start, int end, double sentenceProbInverse, CountsTable counts)
          Computes expected counts for top-level (maximal context) events produced for the specified span when decoding the current sentence; stores these events and their expected counts in the specified CountsTable object.
static CountsTable[] AnalyzeDisns.computeModelEntropies(Model model, CountsTable[] entropy)
          A method to compute a model's entropy statistics for all estimated distributions.
 void Trainer.createPosMap(CountsTable events)
          Adds to Trainer.posMap using information contained in the specified counts table.
 void JointModel.deriveCounts(CountsTable trainerCounts, Filter filter, double threshold, FlexibleMap canonical)
          Derives counts for this Model, as well as for all internal Model instances.
 void Model.deriveCounts(CountsTable trainerCounts, Filter filter, double threshold, FlexibleMap canonical)
          Derives all counts from the specified counts table, using the probability structure specified in the constructor.
 void InterpolatedKnesserNeyModel.deriveCounts(CountsTable trainerCounts, Filter filter, double threshold, FlexibleMap canonical, boolean deriveOtherModelCounts)
           
 void JointModel.deriveCounts(CountsTable trainerCounts, Filter filter, double threshold, FlexibleMap canonical, boolean deriveOtherModelCounts)
          Derives counts for this Model and optionally for all internal Model instances.
 void Model.deriveCounts(CountsTable trainerCounts, Filter filter, double threshold, FlexibleMap canonical, boolean deriveOtherModelCounts)
          Derives all counts from the specified counts table, using the probability structure specified in the constructor.
protected  void Model.deriveHistories(CountsTable trainerCounts, Filter filter, FlexibleMap canonical)
          Deprecated. This method used to be called by Model.deriveCounts(CountsTable,Filter,double,FlexibleMap,boolean), but histories are now derived directly by that method.
static void EventCountsWriter.outputEvents(CountsTable events, Writer out)
          A helper method used both by EventCountsWriter.writeObject(Object) and by the EventCountsConsumer class to write a CountsTable with TrainerEvent keys as text to a Writer.
protected  void Model.precomputeProbs(CountsTable trainerCounts, Filter filter)
          Deprecated. This method has been superseded by Model.precomputeProbs().
 void FileBackedTrainerEventMap.putAll(CountsTable other)
          Throws an UnsupportedOperationException, as this is an unmodifiable map.
 void CountsTable.putAll(CountsTable<K> other)
          Puts the specified map of key objects to their counts into this counts table.
 void CountsTableImpl.putAll(CountsTable<K> other)
           
protected  void Model.savePrecomputeData(CountsTable trainerCounts, Filter filter)
          Saves the back-off chain for each event derived from each TrainerEvent in the key set of the specified counts table.
 void ModelCollection.set(Model lexPriorModel, Model nonterminalPriorModel, Model topNonterminalModel, Model topLexModel, Model headModel, Model gapModel, Model leftSubcatModel, Model rightSubcatModel, Model modNonterminalModel, Model modWordModel, CountsTable vocabCounter, CountsTable wordFeatureCounter, CountsTable nonterminals, Map posMap, Map headToParentMap, Map leftSubcatMap, Map rightSubcatMap, Map modNonterminalMap, Map simpleModNonterminalMap, Set prunedPreterms, Set prunedPunctuation, FlexibleMap canonicalEvents)
          Sets all the data members of this object.
 void ModelCollection.set(Model lexPriorModel, Model nonterminalPriorModel, Model topNonterminalModel, Model topLexModel, Model headModel, Model gapModel, Model leftSubcatModel, Model rightSubcatModel, Model modNonterminalModel, Model modWordModel, CountsTable vocabCounter, CountsTable wordFeatureCounter, CountsTable nonterminals, Map posMap, Map headToParentMap, Map leftSubcatMap, Map rightSubcatMap, Map modNonterminalMap, Map simpleModNonterminalMap, Set prunedPreterms, Set prunedPunctuation, FlexibleMap canonicalEvents)
          Sets all the data members of this object.
 void ModelCollection.set(Model lexPriorModel, Model nonterminalPriorModel, Model topNonterminalModel, Model topLexModel, Model headModel, Model gapModel, Model leftSubcatModel, Model rightSubcatModel, Model modNonterminalModel, Model modWordModel, CountsTable vocabCounter, CountsTable wordFeatureCounter, CountsTable nonterminals, Map posMap, Map headToParentMap, Map leftSubcatMap, Map rightSubcatMap, Map modNonterminalMap, Map simpleModNonterminalMap, Set prunedPreterms, Set prunedPunctuation, FlexibleMap canonicalEvents)
          Sets all the data members of this object.
 void Training.setUpFastArgMap(CountsTable nonterminals)
          Indicates to set up a static map for quickly mapping argument nonterminals to their non-argument variants (that is, for quickly stripping away their argument augmentations).
static void BrokenSubcatBag.setUpFastUidMap(CountsTable nonterminals)
           
static void SubcatBag.setUpFastUidMap(CountsTable nonterminals)
           
 

Uses of CountsTable in danbikel.parser.lang
 

Methods in danbikel.parser.lang with parameters of type CountsTable
 void AbstractTraining.setUpFastArgMap(CountsTable nonterminals)
           
protected static void AbstractTraining.staticSetUpFastArgMap(CountsTable nonterminals)
          Indicates to set up a static map for quickly mapping argument nonterminals to their non-argument variants (that is, for quickly stripping away their argument augmentations).
 

Uses of CountsTable in danbikel.parser.util
 

Methods in danbikel.parser.util that return CountsTable
static CountsTable Util.collectNonterminals(CountsTable counts, Sexp tree, boolean includeTags)
          Adds the nonterminals in the specified tree to the specified set.
static CountsTable Util.collectTags(CountsTable counts, Sexp tree)
          Adds the part of speech tags in the specified tree to the specified set.
 

Methods in danbikel.parser.util with parameters of type CountsTable
static CountsTable Util.collectNonterminals(CountsTable counts, Sexp tree, boolean includeTags)
          Adds the nonterminals in the specified tree to the specified set.
static CountsTable Util.collectTags(CountsTable counts, Sexp tree)
          Adds the part of speech tags in the specified tree to the specified set.
 


Parsing Engine

Author: Dan Bikel.