Package edu.berkeley.nlp.lm.phrasetable
Class PhraseTableValueContainer
java.lang.Object
edu.berkeley.nlp.lm.phrasetable.PhraseTableValueContainer
- All Implemented Interfaces:
ValueContainer<PhraseTableValueContainer.PhraseTableValues>,Serializable
public final class PhraseTableValueContainer
extends Object
implements ValueContainer<PhraseTableValueContainer.PhraseTableValues>
Stored type and token counts necessary for estimating a Kneser-Ney language
model
- Author:
- adampauls
- See Also:
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic classstatic interfacestatic class -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionbooleanadd(int[] ngram, int startPos, int endPos, int ngramOrder, long offset, long contextOffset, int word, PhraseTableValueContainer.PhraseTableValues val, long suffixOffset, boolean ngramIsNew) Adds a new value at the specified offset.voidclearStorageForOrder(int ngramOrder) createFreshValues(long[] numNgramsForEachOrder_) Creates a fresh value container for copying purposes.voidgetFromOffset(long offset, int ngramOrder, PhraseTableValueContainer.PhraseTableValues outputVal) Gets the value living at a particular offset.Creates a fresh value of object (useful for passing as an output parameter)intintnumValueBits(int ngramOrder) voidDestructively sets internal storage from another object.voidInitializes a value container with the map that contains itvoidsetSizeAtLeast(long size, int ngramOrder) Sets internal storage for size for a particular n-gram orderbooleanvoidtrim()Final clean up of storage.voidtrimAfterNgram(int ngramOrder, long size) Clear storage after an n-gram order is complete
-
Constructor Details
-
PhraseTableValueContainer
public PhraseTableValueContainer(int separatorWord, int numFeatures)
-
-
Method Details
-
createFreshValues
Description copied from interface:ValueContainerCreates a fresh value container for copying purposes.- Specified by:
createFreshValuesin interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>- Returns:
-
getFromOffset
public void getFromOffset(long offset, int ngramOrder, PhraseTableValueContainer.PhraseTableValues outputVal) Description copied from interface:ValueContainerGets the value living at a particular offset.- Specified by:
getFromOffsetin interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>- Parameters:
offset-ngramOrder-
-
trimAfterNgram
public void trimAfterNgram(int ngramOrder, long size) Description copied from interface:ValueContainerClear storage after an n-gram order is complete- Specified by:
trimAfterNgramin interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>- Parameters:
ngramOrder-size-
-
getScratchValue
Description copied from interface:ValueContainerCreates a fresh value of object (useful for passing as an output parameter)- Specified by:
getScratchValuein interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>- Returns:
-
add
public boolean add(int[] ngram, int startPos, int endPos, int ngramOrder, long offset, long contextOffset, int word, PhraseTableValueContainer.PhraseTableValues val, long suffixOffset, boolean ngramIsNew) Description copied from interface:ValueContainerAdds a new value at the specified offset.- Specified by:
addin interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>- Parameters:
ngramOrder- As always, ngramOrder is 0-based (0=unigram)offset-contextOffset-word-val-suffixOffset-- Returns:
- Whether or not the add was successful
-
setSizeAtLeast
public void setSizeAtLeast(long size, int ngramOrder) Description copied from interface:ValueContainerSets internal storage for size for a particular n-gram order- Specified by:
setSizeAtLeastin interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>- Parameters:
size-ngramOrder-
-
setFromOtherValues
Description copied from interface:ValueContainerDestructively sets internal storage from another object.- Specified by:
setFromOtherValuesin interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>- Parameters:
other-
-
trim
public void trim()Description copied from interface:ValueContainerFinal clean up of storage.- Specified by:
trimin interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
setMap
Description copied from interface:ValueContainerInitializes a value container with the map that contains it- Specified by:
setMapin interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
getSeparatorWord
public int getSeparatorWord() -
clearStorageForOrder
public void clearStorageForOrder(int ngramOrder) - Specified by:
clearStorageForOrderin interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
storeSuffixoffsets
public boolean storeSuffixoffsets()- Specified by:
storeSuffixoffsetsin interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-
numValueBits
public int numValueBits(int ngramOrder) - Specified by:
numValueBitsin interfaceValueContainer<PhraseTableValueContainer.PhraseTableValues>
-