|
Parsing Engine | |||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use CountsTable | |
---|---|
danbikel.parser | Provides the core framework of this extensible statistical parsing engine. |
danbikel.parser.lang | Provides default abstract base classes for the required interfaces of a language package. |
danbikel.parser.util | Utility classes for displaying and manipulating parse trees. |
Uses of CountsTable in danbikel.parser |
---|
Classes in danbikel.parser that implement CountsTable | |
---|---|
class |
CountsTableImpl<K>
Provides a mapping between objects and floating-point (double) counts that may be incremented or decremented. |
class |
FileBackedTrainerEventMap
Presents an immutable map of a type of TrainerEvent objects to
observed counts, backed by a file of the form output by
Trainer.writeStats(java.io.File) . |
Fields in danbikel.parser declared as CountsTable | |
---|---|
protected CountsTable |
EMDecoder.eventCounts
The map of events to their expected counts (cleared after every sentence). |
protected CountsTable |
Trainer.gapEvents
A table for storing counts of gap-generation events. |
protected CountsTable |
Trainer.headEvents
A table for storing counts of head-generation events. |
protected CountsTable |
Trainer.modifierEvents
A table for storing counts of modifier-generation events. |
protected CountsTable |
ModelCollection.nonterminals
A table that maps unlexicalized nonterminals to their counts in the training corpus. |
protected CountsTable |
Trainer.nonterminals
A table for storing counts of (unlexicalized) nonterminals. |
protected CountsTable |
Trainer.priorEvents
A table for storing counts of lexicalized nonterminal prior events. |
protected CountsTable[] |
Model.smoothingParams
The smoothing parameters for the history contexts ( Event instances)
at the back-off levels of this model. |
protected CountsTable |
ModelCollection.vocabCounter
A table that maps observed words to their counts in the training corpus. |
protected CountsTable |
Trainer.vocabCounter
A table for storing counts of vocabulary items. |
protected CountsTable |
ModelCollection.wordFeatureCounter
A table that maps observed word-feature vectors to their counts in the training corpus. |
protected CountsTable |
Trainer.wordFeatureCounter
A table for storing counts of word feature–vectors. |
Methods in danbikel.parser that return CountsTable | |
---|---|
protected CountsTable |
EMDecoder.computeEventCounts()
Returns a counts table with the expected couunt of all top-level events produced when constrain-parsing the current sentence. |
static CountsTable[] |
AnalyzeDisns.computeModelEntropies(Model model)
A method to compute a model's entropy statistics for all estimated distributions. |
static CountsTable[] |
AnalyzeDisns.computeModelEntropies(Model model,
CountsTable[] entropy)
A method to compute a model's entropy statistics for all estimated distributions. |
static CountsTable[] |
AnalyzeDisns.newEntropyCountsTables(Model model)
Returns an array of CountsTable instances in which to store the
entropy of every history at every back-off level. |
CountsTable |
CachingDecoderServer.nonterminals()
|
CountsTable |
DecoderServer.nonterminals()
Returns the nonterminals CountsTable of the internal
ModelCollection object. |
CountsTable |
DecoderServerRemote.nonterminals()
A counts table of unlexicalized nonterminals, i.e., a map of unlexicalized nonterminals to their respective frequencies in the training data. |
CountsTable |
ModelCollection.nonterminals()
Returns a mapping of (unlexicalized) nonterminals to their counts in the training data. |
protected CountsTable |
EMDecoder.parseAndCollectEventCounts(SexpList sentence)
Constrain-parses the specified sentence and computes expected top-level (maximal context) event counts. |
CountsTable |
EMParser.parseAndCollectEventCounts(SexpList sent)
Collect expected counts for the specified partial parse tree/sentence. |
protected CountsTable |
EMDecoder.parseAndCollectEventCounts(SexpList sentence,
SexpList tags)
Constrain-parses the specified sentence and computes expected top-level (maximal context) event counts. |
protected CountsTable |
EMDecoder.parseAndCollectEventCounts(SexpList sentence,
SexpList tags,
ConstraintSet constraints)
Constrain-parses the specified sentence and computes expected top-level (maximal context) event counts. |
CountsTable |
CountsTrio.transition()
Gets the CountsTable for transitions. |
CountsTable |
ModelCollection.vocabCounter()
Returns a mapping from Symbol objects representing words to
their count in the training data. |
CountsTable |
ModelCollection.wordFeatureCounter()
Returns a mapping from Symbol objects that are word features
to their count in the training data. |
Methods in danbikel.parser with parameters of type CountsTable | |
---|---|
void |
FileBackedTrainerEventMap.addAll(CountsTable other)
Throws an UnsupportedOperationException , as this is an
unmodifiable map. |
void |
CountsTable.addAll(CountsTable<K> other)
Adds all the counts from the specified table to this table, adding any new keys in the specified map to this map, if necessary. |
void |
CountsTableImpl.addAll(CountsTable<K> other)
|
protected void |
EMDecoder.addPretermHeadEvent(EMItem item,
double expectedCount,
CountsTable counts)
Whenever a preterminal is generated, either as a head child or a modifier of some other item, a trivial head-generation event is added, generating the word from the lexicalized preterminal, which by design always generates its head word with probability 1. |
protected void |
EMDecoder.addSynthesizedTopModEvent(TrainerEvent event,
double expectedCount,
CountsTable counts)
Adds an event as though a tree's non-hidden root is a modifier of +TOP+ (in addition to being a head child). |
static void |
AnalyzeDisns.computeEntropyAndJSStats(Model model,
CountsTable[] entropy,
BiCountsTable[] js)
A method invoked by Model when Settings.modelDoPruning is true: entropy values and
JS divergence values are used in the parameter-pruning method. |
protected void |
EMDecoder.computeEventCounts(int start,
int end,
double sentenceProbInverse,
CountsTable counts)
Computes expected counts for top-level (maximal context) events produced for the specified span when decoding the current sentence; stores these events and their expected counts in the specified CountsTable object. |
static CountsTable[] |
AnalyzeDisns.computeModelEntropies(Model model,
CountsTable[] entropy)
A method to compute a model's entropy statistics for all estimated distributions. |
void |
Trainer.createPosMap(CountsTable events)
Adds to Trainer.posMap using information contained in the specified
counts table. |
void |
JointModel.deriveCounts(CountsTable trainerCounts,
Filter filter,
double threshold,
FlexibleMap canonical)
Derives counts for this Model , as well as for all
internal Model instances. |
void |
Model.deriveCounts(CountsTable trainerCounts,
Filter filter,
double threshold,
FlexibleMap canonical)
Derives all counts from the specified counts table, using the probability structure specified in the constructor. |
void |
InterpolatedKnesserNeyModel.deriveCounts(CountsTable trainerCounts,
Filter filter,
double threshold,
FlexibleMap canonical,
boolean deriveOtherModelCounts)
|
void |
JointModel.deriveCounts(CountsTable trainerCounts,
Filter filter,
double threshold,
FlexibleMap canonical,
boolean deriveOtherModelCounts)
Derives counts for this Model and optionally for
all internal Model instances. |
void |
Model.deriveCounts(CountsTable trainerCounts,
Filter filter,
double threshold,
FlexibleMap canonical,
boolean deriveOtherModelCounts)
Derives all counts from the specified counts table, using the probability structure specified in the constructor. |
protected void |
Model.deriveHistories(CountsTable trainerCounts,
Filter filter,
FlexibleMap canonical)
Deprecated. This method used to be called by Model.deriveCounts(CountsTable,Filter,double,FlexibleMap,boolean) , but
histories are now derived directly by that method. |
static void |
EventCountsWriter.outputEvents(CountsTable events,
Writer out)
A helper method used both by EventCountsWriter.writeObject(Object) and by the EventCountsConsumer class to write a CountsTable with TrainerEvent keys as text to a Writer . |
protected void |
Model.precomputeProbs(CountsTable trainerCounts,
Filter filter)
Deprecated. This method has been superseded by Model.precomputeProbs() . |
void |
FileBackedTrainerEventMap.putAll(CountsTable other)
Throws an UnsupportedOperationException , as this is an
unmodifiable map. |
void |
CountsTable.putAll(CountsTable<K> other)
Puts the specified map of key objects to their counts into this counts table. |
void |
CountsTableImpl.putAll(CountsTable<K> other)
|
protected void |
Model.savePrecomputeData(CountsTable trainerCounts,
Filter filter)
Saves the back-off chain for each event derived from each TrainerEvent in the key set of the specified counts table. |
void |
ModelCollection.set(Model lexPriorModel,
Model nonterminalPriorModel,
Model topNonterminalModel,
Model topLexModel,
Model headModel,
Model gapModel,
Model leftSubcatModel,
Model rightSubcatModel,
Model modNonterminalModel,
Model modWordModel,
CountsTable vocabCounter,
CountsTable wordFeatureCounter,
CountsTable nonterminals,
Map posMap,
Map headToParentMap,
Map leftSubcatMap,
Map rightSubcatMap,
Map modNonterminalMap,
Map simpleModNonterminalMap,
Set prunedPreterms,
Set prunedPunctuation,
FlexibleMap canonicalEvents)
Sets all the data members of this object. |
void |
ModelCollection.set(Model lexPriorModel,
Model nonterminalPriorModel,
Model topNonterminalModel,
Model topLexModel,
Model headModel,
Model gapModel,
Model leftSubcatModel,
Model rightSubcatModel,
Model modNonterminalModel,
Model modWordModel,
CountsTable vocabCounter,
CountsTable wordFeatureCounter,
CountsTable nonterminals,
Map posMap,
Map headToParentMap,
Map leftSubcatMap,
Map rightSubcatMap,
Map modNonterminalMap,
Map simpleModNonterminalMap,
Set prunedPreterms,
Set prunedPunctuation,
FlexibleMap canonicalEvents)
Sets all the data members of this object. |
void |
ModelCollection.set(Model lexPriorModel,
Model nonterminalPriorModel,
Model topNonterminalModel,
Model topLexModel,
Model headModel,
Model gapModel,
Model leftSubcatModel,
Model rightSubcatModel,
Model modNonterminalModel,
Model modWordModel,
CountsTable vocabCounter,
CountsTable wordFeatureCounter,
CountsTable nonterminals,
Map posMap,
Map headToParentMap,
Map leftSubcatMap,
Map rightSubcatMap,
Map modNonterminalMap,
Map simpleModNonterminalMap,
Set prunedPreterms,
Set prunedPunctuation,
FlexibleMap canonicalEvents)
Sets all the data members of this object. |
void |
Training.setUpFastArgMap(CountsTable nonterminals)
Indicates to set up a static map for quickly mapping argument nonterminals to their non-argument variants (that is, for quickly stripping away their argument augmentations). |
static void |
BrokenSubcatBag.setUpFastUidMap(CountsTable nonterminals)
|
static void |
SubcatBag.setUpFastUidMap(CountsTable nonterminals)
|
Uses of CountsTable in danbikel.parser.lang |
---|
Methods in danbikel.parser.lang with parameters of type CountsTable | |
---|---|
void |
AbstractTraining.setUpFastArgMap(CountsTable nonterminals)
|
protected static void |
AbstractTraining.staticSetUpFastArgMap(CountsTable nonterminals)
Indicates to set up a static map for quickly mapping argument nonterminals to their non-argument variants (that is, for quickly stripping away their argument augmentations). |
Uses of CountsTable in danbikel.parser.util |
---|
Methods in danbikel.parser.util that return CountsTable | |
---|---|
static CountsTable |
Util.collectNonterminals(CountsTable counts,
Sexp tree,
boolean includeTags)
Adds the nonterminals in the specified tree to the specified set. |
static CountsTable |
Util.collectTags(CountsTable counts,
Sexp tree)
Adds the part of speech tags in the specified tree to the specified set. |
Methods in danbikel.parser.util with parameters of type CountsTable | |
---|---|
static CountsTable |
Util.collectNonterminals(CountsTable counts,
Sexp tree,
boolean includeTags)
Adds the nonterminals in the specified tree to the specified set. |
static CountsTable |
Util.collectTags(CountsTable counts,
Sexp tree)
Adds the part of speech tags in the specified tree to the specified set. |
|
Parsing Engine | |||||||||
PREV NEXT | FRAMES NO FRAMES |