Uses of Interface
opennlp.tools.util.ObjectStream
Packages that use ObjectStream
Package
Description
Package related to finding non-recursive syntactic annotation such as noun phrase chunks.
Package for classifying a document into a category.
Experimental package related to converting various corpora to OpenNLP Format.
Experimental package related to the
Arvores Deitadas corpus
format.Experimental package related to the corpus format used by the "brat rapid annotation tool" (brat).
Experimental package related to the CoNNL-U format.
Experimental package related to the French Treebank format.
Experimental package related to the Irish Sentence Bank format.
Experimental package related to the
Leipzig
corpus format.Experimental package related to the
letsmt
corpus format.Experimental package related to the
MASC
corpus format.Experimental package related to the
MUC
corpus format.Experimental package related to the National corpus of Polish
NKJP
format.Experimental package related to the OntoNotes 4.0 format.
Package related to predicting languages from samples of text.
Package related to the lemmatizer functionality.
Package related to Machine Learning (ML) features of OpenNLP, the related ML models, and trainers.
Package related to ML by means of the Maximum Entropy (ME) algorithm.
Package related to ML models and feature selection techniques.
Package related to finding proper names and numeric amounts.
Package containing common code for performing full syntactic parsing.
Package containing code for performing full syntactic parsing using shift/reduce-style decisions.
Package containing experimental code for performing full syntactic
parsing using attachment decisions.
Package related to part-of-speech tagging.
Package related to identifying sentence boundaries.
Contains classes related to finding token or words in a string.
Package containing utility data structures and algorithms used by multiple other packages.
-
Uses of ObjectStream in opennlp.tools.chunker
Classes in opennlp.tools.chunker that implement ObjectStreamModifier and TypeClassDescriptionclass
Class for creating an event stream out of data files for training aChunker
.class
ASequenceStream
implementation encapsulatingsamples
.class
Parses the conll 2000 shared task shallow parser training data.Methods in opennlp.tools.chunker with parameters of type ObjectStreamModifier and TypeMethodDescriptionvoid
ChunkerCrossValidator.evaluate
(ObjectStream<ChunkSample> samples, int nFolds) Starts the evaluation.static ChunkerModel
ChunkerME.train
(String lang, ObjectStream<ChunkSample> in, TrainingParameters mlParams, ChunkerFactory factory) Starts a training of aChunkerModel
with the given parameters.Constructors in opennlp.tools.chunker with parameters of type ObjectStreamModifierConstructorDescriptionCreates a new event stream based on the specified data stream using the given context generator.ChunkSampleSequenceStream
(ObjectStream<ChunkSample> samples, ChunkerContextGenerator generator) ChunkSampleStream
(ObjectStream<String> samples) Initializes ainstance
. -
Uses of ObjectStream in opennlp.tools.cmdline.namefind
Classes in opennlp.tools.cmdline.namefind that implement ObjectStreamModifier and TypeClassDescriptionclass
Counts tokens, sentences and names by type.Methods in opennlp.tools.cmdline.namefind with parameters of type ObjectStreamModifier and TypeMethodDescriptionstatic Dictionary
CensusDictionaryCreatorTool.createDictionary
(ObjectStream<StringList> sampleStream) Creates a dictionary.Constructors in opennlp.tools.cmdline.namefind with parameters of type ObjectStreamModifierConstructorDescriptionprotected
NameSampleCountersStream
(ObjectStream<NameSample> samples) -
Uses of ObjectStream in opennlp.tools.cmdline.parser
Methods in opennlp.tools.cmdline.parser with parameters of type ObjectStreamModifier and TypeMethodDescriptionprotected ParserModel
BuildModelUpdaterTool.trainAndUpdate
(ParserModel originalModel, ObjectStream<Parse> parseSamples, opennlp.tools.cmdline.parser.ModelUpdaterTool.ModelUpdaterParams parameters) protected ParserModel
CheckModelUpdaterTool.trainAndUpdate
(ParserModel originalModel, ObjectStream<Parse> parseSamples, opennlp.tools.cmdline.parser.ModelUpdaterTool.ModelUpdaterParams parameters) -
Uses of ObjectStream in opennlp.tools.doccat
Classes in opennlp.tools.doccat that implement ObjectStreamModifier and TypeClassDescriptionclass
Iterator-like class for modeling document classification events.class
Reads in string encoded training samples, parses them and outputsDocumentSample
objects.Methods in opennlp.tools.doccat with parameters of type ObjectStreamModifier and TypeMethodDescriptionvoid
DoccatCrossValidator.evaluate
(ObjectStream<DocumentSample> samples, int nFolds) Starts the evaluation.static DoccatModel
DocumentCategorizerME.train
(String lang, ObjectStream<DocumentSample> samples, TrainingParameters mlParams, DoccatFactory factory) Starts a training of aDoccatModel
with the given parameters.Constructors in opennlp.tools.doccat with parameters of type ObjectStreamModifierConstructorDescriptionInitializes aDocumentCategorizerEventStream
via samples.DocumentCategorizerEventStream
(ObjectStream<DocumentSample> samples, FeatureGenerator... featureGenerators) Initializes aDocumentCategorizerEventStream
via samples andfeature generators
.DocumentSampleStream
(ObjectStream<String> samples) Initializes ainstance
. -
Uses of ObjectStream in opennlp.tools.formats
Classes in opennlp.tools.formats that implement ObjectStreamModifier and TypeClassDescriptionclass
Asample stream
for the training files of the BioNLP/NLPBA 2004 shared task.class
Parser for the Dutch and Spanish ner training files of the CONLL 2002 shared task.class
An import stream which can parse the CONLL03 data.class
Parses the data from the CONLL 06 shared task into POS Samples.class
The directory sample stream allows for creating anObjectStream<File>
from a directory listing of files.class
Parser for the Italian NER training files of the Evalita 2007 and 2009 NER shared tasks.class
This class helps to read the US Census data from the files to build a StringList for each dictionary entry in the name-finder dictionary.class
Methods in opennlp.tools.formats that return ObjectStreamModifier and TypeMethodDescriptionConstructors in opennlp.tools.formats with parameters of type ObjectStreamModifierConstructorDescriptionConll02NameSampleStream
(Conll02NameSampleStream.LANGUAGE lang, ObjectStream<String> lineStream, int types) Initializes aConll02NameSampleStream
.Conll03NameSampleStream
(Conll03NameSampleStream.LANGUAGE lang, ObjectStream<String> lineStream, int types) Initializes aConll03NameSampleStream
.ConllXPOSSampleStream
(ObjectStream<String> lineStream) Initializes aConllXPOSSampleStream
.EvalitaNameSampleStream
(EvalitaNameSampleStream.LANGUAGE lang, ObjectStream<String> lineStream, int types) NameFinderCensus90NameStream
(ObjectStream<String> lineStream) Initializes aNameFinderCensus90NameStream
viaObjectStream<String>
. -
Uses of ObjectStream in opennlp.tools.formats.ad
Classes in opennlp.tools.formats.ad that implement ObjectStreamModifier and TypeClassDescriptionclass
Parser for Floresta Sita(c)tica Arvores Deitadas corpus, output to for the Portuguese Chunker training.class
Parser for Floresta Sita(c)tica Arvores Deitadas corpus, output to for the Portuguese NER training.class
Note: Do not use this class, internal use only!class
Note: Do not use this class, internal use only!class
Stream filter which merges text lines into sentences, following the Arvores Deitadas syntax.Fields in opennlp.tools.formats.ad declared as ObjectStreamModifier and TypeFieldDescriptionprotected final ObjectStream<ADSentenceStream.Sentence>
ADChunkSampleStream.adSentenceStream
Methods in opennlp.tools.formats.ad that return ObjectStreamModifier and TypeMethodDescriptionConstructors in opennlp.tools.formats.ad with parameters of type ObjectStreamModifierConstructorDescriptionADChunkSampleStream
(ObjectStream<String> lineStream) Instantiates aADChunkSampleStream
stream fromObjectStream<String>
, that could be aPlainTextByLineStream
object.ADNameSampleStream
(ObjectStream<String> lineStream, boolean splitHyphenatedTokens) Initializes a newADNameSampleStream
stream from aObjectStream<String>
, that could be aPlainTextByLineStream
object.ADPOSSampleStream
(ObjectStream<String> lineStream, boolean expandME, boolean includeFeatures) Creates a newADPOSSampleStream
stream from aObjectStream<String>
, that could be aPlainTextByLineStream
object.ADSentenceSampleStream
(ObjectStream<String> lineStream, boolean includeHeadlines) Initializes a newADSentenceSampleStream
from aObjectStream<String>
, that could be aPlainTextByLineStream
object.ADSentenceStream
(ObjectStream<String> lineStream) -
Uses of ObjectStream in opennlp.tools.formats.brat
Classes in opennlp.tools.formats.brat that implement ObjectStreamModifier and TypeClassDescriptionclass
Reads the annotations from the brat.ann
annotation file.class
class
Generates Name Sample objects for a Brat Document object.class
Methods in opennlp.tools.formats.brat that return ObjectStreamModifier and TypeMethodDescriptionConstructors in opennlp.tools.formats.brat with parameters of type ObjectStreamModifierConstructorDescriptionBratNameSampleStream
(SentenceDetector sentDetector, Tokenizer tokenizer, ObjectStream<BratDocument> samples) Creates a newBratNameSampleStream
.BratNameSampleStream
(SentenceDetector sentDetector, Tokenizer tokenizer, ObjectStream<BratDocument> samples, Set<String> nameTypes) Creates a newBratNameSampleStream
.BratNameSampleStream
(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples) Creates a newBratNameSampleStream
.BratNameSampleStream
(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples, Set<String> nameTypes) Creates a newBratNameSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.conllu
Classes in opennlp.tools.formats.conllu that implement ObjectStreamModifier and TypeClassDescriptionclass
class
class
class
The CoNNL-U Format is specified here.class
Methods in opennlp.tools.formats.conllu that return ObjectStreamModifier and TypeMethodDescriptionConstructors in opennlp.tools.formats.conllu with parameters of type ObjectStreamModifierConstructorDescriptionConlluLemmaSampleStream
(ObjectStream<ConlluSentence> samples, ConlluTagset tagset) Initializes aConlluLemmaSampleStream
.ConlluPOSSampleStream
(ObjectStream<ConlluSentence> samples, ConlluTagset tagset) Initializes aConlluPOSSampleStream
.ConlluSentenceSampleStream
(ObjectStream<ConlluSentence> samples, int sentencesPerSample) Initializes aConlluSentenceSampleStream
.Initializes aConlluTokenSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.convert
Classes in opennlp.tools.formats.convert that implement ObjectStreamModifier and TypeClassDescriptionclass
class
Note: Do not use this class, internal use only!class
Provides the ability to read the contents of files contained in an object stream of files.class
Note: Do not use this class, internal use only!class
Note: Do not use this class, internal use only!class
Note: Do not use this class, internal use only!class
Note: Do not use this class, internal use only!class
Note: Do not use this class, internal use only!Methods in opennlp.tools.formats.convert that return ObjectStreamModifier and TypeMethodDescriptionConstructors in opennlp.tools.formats.convert with parameters of type ObjectStreamModifierConstructorDescriptionFileToByteArraySampleStream
(ObjectStream<File> samples) Initializes aFileToByteArraySampleStream
.FileToStringSampleStream
(ObjectStream<File> samples, Charset encoding) Initializes aFileToStringSampleStream
.NameToSentenceSampleStream
(Detokenizer detokenizer, ObjectStream<NameSample> samples, int chunkSize) Initializes aNameToSentenceSampleStream
.NameToTokenSampleStream
(Detokenizer detokenizer, ObjectStream<NameSample> samples) Initializes aNameToTokenSampleStream
.ParseToPOSSampleStream
(ObjectStream<Parse> samples) Initializes aParseToPOSSampleStream
.POSToSentenceSampleStream
(Detokenizer detokenizer, ObjectStream<POSSample> samples, int chunkSize) Initializes aPOSToSentenceSampleStream
.POSToTokenSampleStream
(Detokenizer detokenizer, ObjectStream<POSSample> samples) Initializes aPOSToTokenSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.frenchtreebank
Classes in opennlp.tools.formats.frenchtreebank that implement ObjectStreamMethods in opennlp.tools.formats.frenchtreebank that return ObjectStreamModifier and TypeMethodDescriptionConstructors in opennlp.tools.formats.frenchtreebank with parameters of type ObjectStreamModifierConstructorDescriptionprotected
ConstitParseSampleStream
(ObjectStream<byte[]> samples) Initializes aConstitParseSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.irishsentencebank
Methods in opennlp.tools.formats.irishsentencebank that return ObjectStreamModifier and TypeMethodDescription -
Uses of ObjectStream in opennlp.tools.formats.leipzig
Classes in opennlp.tools.formats.leipzig that implement ObjectStreamMethods in opennlp.tools.formats.leipzig that return ObjectStreamModifier and TypeMethodDescription -
Uses of ObjectStream in opennlp.tools.formats.letsmt
Classes in opennlp.tools.formats.letsmt that implement ObjectStreamMethods in opennlp.tools.formats.letsmt that return ObjectStreamModifier and TypeMethodDescriptionConstructors in opennlp.tools.formats.letsmt with parameters of type ObjectStreamModifierConstructorDescriptionDetokenizeSentenceSampleStream
(Detokenizer detokenizer, ObjectStream<SentenceSample> samples) Initializes aDetokenizeSentenceSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.masc
Classes in opennlp.tools.formats.masc that implement ObjectStreamModifier and TypeClassDescriptionclass
class
class
class
class
Methods in opennlp.tools.formats.masc that return ObjectStreamModifier and TypeMethodDescriptionConstructors in opennlp.tools.formats.masc with parameters of type ObjectStreamModifierConstructorDescriptionInitializesMascNamedEntitySampleStream
from a stream ofdocuments
.MascPOSSampleStream
(ObjectStream<MascDocument> samples) InitializesMascPOSSampleStream
from a stream ofdocuments
.MascSentenceSampleStream
(ObjectStream<MascDocument> samples, int sentencesPerSample) MascTokenSampleStream
(ObjectStream<MascDocument> samples) Initializes aMascTokenSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.moses
Classes in opennlp.tools.formats.moses that implement ObjectStreamMethods in opennlp.tools.formats.moses that return ObjectStreamModifier and TypeMethodDescriptionConstructors in opennlp.tools.formats.moses with parameters of type ObjectStreamModifierConstructorDescriptionMosesSentenceSampleStream
(ObjectStream<String> sentences) Initializes aMosesSentenceSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.muc
Classes in opennlp.tools.formats.muc that implement ObjectStreamMethods in opennlp.tools.formats.muc that return ObjectStreamModifier and TypeMethodDescriptionConstructors in opennlp.tools.formats.muc with parameters of type ObjectStreamModifierConstructorDescriptionprotected
MucNameSampleStream
(Tokenizer tokenizer, ObjectStream<String> samples) Initializes aMucNameSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.nkjp
Classes in opennlp.tools.formats.nkjp that implement ObjectStreamMethods in opennlp.tools.formats.nkjp that return ObjectStreamModifier and TypeMethodDescription -
Uses of ObjectStream in opennlp.tools.formats.ontonotes
Classes in opennlp.tools.formats.ontonotes that implement ObjectStreamModifier and TypeClassDescriptionclass
Reads a plain text file and return each line as aString
object.class
Name Sample Stream parser for the OntoNotes 4.0 corpus.class
Methods in opennlp.tools.formats.ontonotes that return ObjectStreamModifier and TypeMethodDescriptionConstructors in opennlp.tools.formats.ontonotes with parameters of type ObjectStreamModifierConstructorDescriptionDocumentToLineStream
(ObjectStream<String> samples) Initializes aDocumentToLineStream
.OntoNotesNameSampleStream
(ObjectStream<String> samples) Initializes aOntoNotesNameSampleStream
.OntoNotesParseSampleStream
(ObjectStream<String> samples) Initializes aOntoNotesParseSampleStream
. -
Uses of ObjectStream in opennlp.tools.langdetect
Classes in opennlp.tools.langdetect that implement ObjectStreamModifier and TypeClassDescriptionclass
Iterator-like class for modeling an event stream ofsamples
.class
This class reads in string encodedtraining samples
, parses them and outputsLanguageSample
objects.Methods in opennlp.tools.langdetect with parameters of type ObjectStreamModifier and TypeMethodDescriptionvoid
LanguageDetectorCrossValidator.evaluate
(ObjectStream<LanguageSample> samples, int nFolds) Starts the evaluation.static LanguageDetectorModel
LanguageDetectorME.train
(ObjectStream<LanguageSample> samples, TrainingParameters mlParams, LanguageDetectorFactory factory) Starts a training of aLanguageDetectorModel
with the given parameters.Constructors in opennlp.tools.langdetect with parameters of type ObjectStreamModifierConstructorDescriptionInitializes an instance via samples and feature generators.LanguageDetectorSampleStream
(ObjectStream<String> samples) Initializes ainstance
. -
Uses of ObjectStream in opennlp.tools.lemmatizer
Classes in opennlp.tools.lemmatizer that implement ObjectStreamModifier and TypeClassDescriptionclass
Class for creating an event stream out of data files for training a probabilisticLemmatizer
.class
ASequenceStream
implementation encapsulatingsamples
.class
Reads data for training and testing theLemmatizer
.Methods in opennlp.tools.lemmatizer with parameters of type ObjectStreamModifier and TypeMethodDescriptionstatic LemmatizerModel
LemmatizerME.train
(String languageCode, ObjectStream<LemmaSample> samples, TrainingParameters params, LemmatizerFactory factory) Starts a training of aLemmatizerModel
with the given parameters.Constructors in opennlp.tools.lemmatizer with parameters of type ObjectStreamModifierConstructorDescriptionCreates a new event stream based on the specified data stream using aLemmatizerContextGenerator
.LemmaSampleSequenceStream
(ObjectStream<LemmaSample> samples, LemmatizerContextGenerator contextGenerator) LemmaSampleStream
(ObjectStream<String> samples) Initializes ainstance
. -
Uses of ObjectStream in opennlp.tools.ml
Methods in opennlp.tools.ml with parameters of type ObjectStreamModifier and TypeMethodDescriptionAbstractEventTrainer.getDataIndexer
(ObjectStream<Event> events) final MaxentModel
AbstractEventTrainer.train
(ObjectStream<Event> events) EventTrainer.train
(ObjectStream<Event> events) Trains aMaxentModel
for givenevents
. -
Uses of ObjectStream in opennlp.tools.ml.maxent
Classes in opennlp.tools.ml.maxent that implement ObjectStreamMethods in opennlp.tools.ml.maxent with parameters of type ObjectStreamModifier and TypeMethodDescriptionGISTrainer.trainModel
(ObjectStream<Event> eventStream) Trains a model using the GIS algorithm, assuming 100 iterations and no cutoff.GISTrainer.trainModel
(ObjectStream<Event> eventStream, int iterations, int cutoff) Trains a GIS model on the event in the specified event stream, using the specified number of iterations and the specified count cutoff.Constructors in opennlp.tools.ml.maxent with parameters of type ObjectStream -
Uses of ObjectStream in opennlp.tools.ml.model
Subinterfaces of ObjectStream in opennlp.tools.ml.modelModifier and TypeInterfaceDescriptioninterface
Interface for streams ofsequences
used to train sequence models.Classes in opennlp.tools.ml.model that implement ObjectStreamModifier and TypeClassDescriptionclass
Class for using a file ofevents
as anevent stream
.class
A hash sum basedAbstractObjectStream
implementation.class
Class for using a file of real-valuedevents
as anevent stream
.class
Class which turns aSequenceStream
into an event stream.Methods in opennlp.tools.ml.model with parameters of type ObjectStreamModifier and TypeMethodDescriptionprotected List<ComparableEvent>
Performs the data indexing.void
DataIndexer.index
(ObjectStream<Event> eventStream) Performs the data indexing.void
OnePassDataIndexer.index
(ObjectStream<Event> eventStream) Performs the data indexing.void
TwoPassDataIndexer.index
(ObjectStream<Event> eventStream) Performs the data indexing.Constructors in opennlp.tools.ml.model with parameters of type ObjectStream -
Uses of ObjectStream in opennlp.tools.namefind
Classes in opennlp.tools.namefind that implement ObjectStreamModifier and TypeClassDescriptionclass
Class for creating an event stream out of data files for training anTokenNameFinder
.class
TheNameSampleDataStream
class converts taggedstrings
provided by aDataStream
toNameSample
objects.class
ASequenceStream
implementation encapsulatingsamples
.class
Astream
which removesname samples
which do not have a certain type.Methods in opennlp.tools.namefind with parameters of type ObjectStreamModifier and TypeMethodDescriptionvoid
TokenNameFinderCrossValidator.evaluate
(ObjectStream<NameSample> samples, int nFolds) Starts the evaluation.static TokenNameFinderModel
NameFinderME.train
(String languageCode, String type, ObjectStream<NameSample> samples, TrainingParameters params, TokenNameFinderFactory factory) Starts a training of aTokenNameFinderModel
with the given parameters.Constructors in opennlp.tools.namefind with parameters of type ObjectStreamModifierConstructorDescriptionNameFinderEventStream
(ObjectStream<NameSample> dataStream, String type, NameContextGenerator contextGenerator, SequenceCodec<String> codec) Initializes aNameSampleDataStream
with givenpsi
samples.Initializes aNameSampleSequenceStream
with givenpsi
samples.NameSampleSequenceStream
(ObjectStream<NameSample> psi, NameContextGenerator pcg, boolean useOutcomes) NameSampleSequenceStream
(ObjectStream<NameSample> psi, NameContextGenerator pcg, boolean useOutcomes, SequenceCodec<String> seqCodec) NameSampleSequenceStream
(ObjectStream<NameSample> psi, AdaptiveFeatureGenerator featureGen) NameSampleSequenceStream
(ObjectStream<NameSample> psi, AdaptiveFeatureGenerator featureGen, boolean useOutcomes) NameSampleTypeFilter
(String[] types, ObjectStream<NameSample> samples) Initializes aNameSampleTypeFilter
.NameSampleTypeFilter
(Set<String> types, ObjectStream<NameSample> samples) Initializes aNameSampleTypeFilter
. -
Uses of ObjectStream in opennlp.tools.parser
Classes in opennlp.tools.parser that implement ObjectStreamModifier and TypeClassDescriptionclass
Abstract class extended by parser event streams which perform tagging and chunking.class
class
class
Methods in opennlp.tools.parser with parameters of type ObjectStreamModifier and TypeMethodDescriptionstatic Dictionary
AbstractBottomUpParser.buildDictionary
(ObjectStream<Parse> data, HeadRules rules, int cutoff) Creates a n-gramDictionary
from the specified data stream usingHeadRules
and specified cut-off.static Dictionary
AbstractBottomUpParser.buildDictionary
(ObjectStream<Parse> data, HeadRules rules, TrainingParameters params) Creates a n-gramDictionary
from the specified data stream using the specified head rule and specified cut-off.void
ParserCrossValidator.evaluate
(ObjectStream<Parse> samples, int nFolds) Starts the evaluation.Constructors in opennlp.tools.parser with parameters of type ObjectStreamModifierConstructorDescriptionAbstractParserEventStream
(ObjectStream<Parse> d, HeadRules rules, ParserEventTypeEnum etype) AbstractParserEventStream
(ObjectStream<Parse> d, HeadRules rules, ParserEventTypeEnum etype, Dictionary dict) Initializes ainstance
.Initializes ainstance
.Initializes ainstance
. -
Uses of ObjectStream in opennlp.tools.parser.chunking
Classes in opennlp.tools.parser.chunking that implement ObjectStreamModifier and TypeClassDescriptionclass
Wrapper class for one of fourshift-reduce parser
event streams.Methods in opennlp.tools.parser.chunking with parameters of type ObjectStreamModifier and TypeMethodDescriptionstatic ParserModel
Parser.train
(String languageCode, ObjectStream<Parse> parseSamples, HeadRules rules, TrainingParameters mlParams) Starts a training of aParserModel
.Constructors in opennlp.tools.parser.chunking with parameters of type ObjectStreamModifierConstructorDescriptionParserEventStream
(ObjectStream<Parse> d, HeadRules rules, ParserEventTypeEnum etype) ParserEventStream
(ObjectStream<Parse> d, HeadRules rules, ParserEventTypeEnum etype, Dictionary dict) -
Uses of ObjectStream in opennlp.tools.parser.treeinsert
Classes in opennlp.tools.parser.treeinsert that implement ObjectStreamModifier and TypeClassDescriptionclass
Wrapper class for one of fourbuilt-attach parser
event streams.Methods in opennlp.tools.parser.treeinsert with parameters of type ObjectStreamModifier and TypeMethodDescriptionstatic ParserModel
Parser.train
(String languageCode, ObjectStream<Parse> parseSamples, HeadRules rules, int iterations, int cutoff) Starts a training of aParserModel
.static ParserModel
Parser.train
(String languageCode, ObjectStream<Parse> parseSamples, HeadRules rules, TrainingParameters mlParams) Starts a training of aParserModel
.Constructors in opennlp.tools.parser.treeinsert with parameters of type ObjectStreamModifierConstructorDescriptionParserEventStream
(ObjectStream<Parse> d, HeadRules rules, ParserEventTypeEnum etype) ParserEventStream
(ObjectStream<Parse> d, HeadRules rules, ParserEventTypeEnum etype, Dictionary dict) -
Uses of ObjectStream in opennlp.tools.postag
Classes in opennlp.tools.postag that implement ObjectStreamModifier and TypeClassDescriptionclass
class
ASequenceStream
implementation encapsulatingsamples
.class
A stream filter which reads a sentence per line which contains words and tags inword_tag
format and outputs aPOSSample
objects.Methods in opennlp.tools.postag with parameters of type ObjectStreamModifier and TypeMethodDescriptionstatic Dictionary
POSTaggerME.buildNGramDictionary
(ObjectStream<POSSample> samples, int cutoff) Constructs anGram dictionary
from anObjectStream
of samples.void
POSTaggerCrossValidator.evaluate
(ObjectStream<POSSample> samples, int nFolds) Starts the evaluation.static void
POSTaggerME.populatePOSDictionary
(ObjectStream<POSSample> samples, MutableTagDictionary dict, int cutoff) Populates aPOSDictionary
from anObjectStream
of samples.static POSModel
POSTaggerME.train
(String languageCode, ObjectStream<POSSample> samples, TrainingParameters trainParams, POSTaggerFactory posFactory) Constructors in opennlp.tools.postag with parameters of type ObjectStreamModifierConstructorDescriptionPOSSampleEventStream
(ObjectStream<POSSample> samples) Initializes the current instance with given samples and aDefaultPOSContextGenerator
.POSSampleEventStream
(ObjectStream<POSSample> samples, POSContextGenerator cg) Initializes the current instance with the given samples and aPOSContextGenerator
.WordTagSampleStream
(ObjectStream<String> sentences) Initializes aPOSSample
instance. -
Uses of ObjectStream in opennlp.tools.sentdetect
Classes in opennlp.tools.sentdetect that implement ObjectStreamModifier and TypeClassDescriptionclass
ObjectStream
to clean up empty lines for empty line separated document streams.
- Skips empty line at training data start
- Transforms multiple empty lines in a row into one
- Replaces white space lines with empty lines
- TODO: Terminates last document with empty line if it is missing
This stream should be used by the components that mark empty lines to mark document boundaries.class
class
This class is a stream filter which reads a sentence by line samples from anObjectStream
and converts them intoSentenceSample
objects.Methods in opennlp.tools.sentdetect with parameters of type ObjectStreamModifier and TypeMethodDescriptionvoid
SDCrossValidator.evaluate
(ObjectStream<SentenceSample> samples, int nFolds) Starts the evaluation.static SentenceModel
SentenceDetectorME.train
(String languageCode, ObjectStream<SentenceSample> samples, boolean useTokenEnd, Dictionary abbreviations, TrainingParameters mlParams) Deprecated.static SentenceModel
SentenceDetectorME.train
(String languageCode, ObjectStream<SentenceSample> samples, SentenceDetectorFactory sdFactory, TrainingParameters mlParams) Constructors in opennlp.tools.sentdetect with parameters of type ObjectStreamModifierConstructorDescriptionSDEventStream
(ObjectStream<SentenceSample> samples, SDContextGenerator cg, EndOfSentenceScanner scanner) Initializes the current instance.SentenceSampleStream
(ObjectStream<String> sentences) -
Uses of ObjectStream in opennlp.tools.tokenize
Classes in opennlp.tools.tokenize that implement ObjectStreamModifier and TypeClassDescriptionclass
class
This class is astream filter
which reads in string encoded samples and createssamples
out of them.class
class
This stream formatsObjectStream
ofsamples
into whitespace separated token strings.Methods in opennlp.tools.tokenize with parameters of type ObjectStreamModifier and TypeMethodDescriptionvoid
TokenizerCrossValidator.evaluate
(ObjectStream<TokenSample> samples, int nFolds) Starts the evaluation.static TokenizerModel
TokenizerME.train
(ObjectStream<TokenSample> samples, TokenizerFactory factory, TrainingParameters mlParams) Trains a model for theTokenizerME
.Constructors in opennlp.tools.tokenize with parameters of type ObjectStreamModifierConstructorDescriptionTokenizerStream
(Tokenizer tokenizer, ObjectStream<String> input) Initializes ainstance
.TokenSampleStream
(ObjectStream<String> sentences) Initializes ainstance
.TokenSampleStream
(ObjectStream<String> samples, String separatorChars) Initializes ainstance
.TokSpanEventStream
(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics) Initializes a new event stream based on the data stream using aTokenContextGenerator
that relies on aDefaultTokenContextGenerator
.TokSpanEventStream
(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, Pattern alphaNumeric, TokenContextGenerator cg) Initializes a new event stream based on the data stream using aTokenContextGenerator
.TokSpanEventStream
(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, TokenContextGenerator cg) Initializes a new event stream based on the data stream using aTokenContextGenerator
.WhitespaceTokenStream
(ObjectStream<TokenSample> tokens) Initializes aWhitespaceTokenStream
. -
Uses of ObjectStream in opennlp.tools.util
Classes in opennlp.tools.util that implement ObjectStreamModifier and TypeClassDescriptionclass
A baseObjectStream
implementation for events.class
A baseObjectStream
implementation.class
AnObjectStream
implementation that works on aCollection
ofCollectionObjectStream
as source for elements.class
class
FilterObjectStream<S,
T> Abstract base class for filteringstreams
.class
AFilterObjectStream
which merges text lines into paragraphs.class
Reads a plain text file and returns each line as aString
object.Fields in opennlp.tools.util declared as ObjectStreamMethods in opennlp.tools.util that return ObjectStreamModifier and TypeMethodDescriptionstatic <T> ObjectStream<T>
ObjectStreamUtils.concatenateObjectStream
(Collection<ObjectStream<T>> streams) Creates a single concatenatedObjectStream
from multiple individualstreams
with the same typeObjectStreamUtils
.static <T> ObjectStream<T>
ObjectStreamUtils.concatenateObjectStream
(ObjectStream<T>... streams) Creates a single concatenatedObjectStream
from multiple individualstreams
with the same type.static <T> ObjectStream<T>
ObjectStreamUtils.createObjectStream
(Collection<T> collection) Creates anObjectStream
form aCollection<T>
.static <T> ObjectStream<T>
ObjectStreamUtils.createObjectStream
(T... array) Creates anObjectStream
form an array ofObjectStreamUtils
.Methods in opennlp.tools.util with parameters of type ObjectStreamModifier and TypeMethodDescriptionstatic <T> ObjectStream<T>
ObjectStreamUtils.concatenateObjectStream
(ObjectStream<T>... streams) Creates a single concatenatedObjectStream
from multiple individualstreams
with the same type.Method parameters in opennlp.tools.util with type arguments of type ObjectStreamModifier and TypeMethodDescriptionstatic <T> ObjectStream<T>
ObjectStreamUtils.concatenateObjectStream
(Collection<ObjectStream<T>> streams) Creates a single concatenatedObjectStream
from multiple individualstreams
with the same typeObjectStreamUtils
.Constructors in opennlp.tools.util with parameters of type ObjectStreamModifierConstructorDescriptionAbstractEventStream
(ObjectStream<T> samples) Initializes anAbstractEventStream
with a sampleIterator
.protected
AbstractObjectStream
(ObjectStream<T> stream) Initializes anAbstractObjectStream
.EventTraceStream
(ObjectStream<Event> stream, Writer writer) Initializes anEventTraceStream
.protected
FilterObjectStream
(ObjectStream<S> samples) Initializes anFilterObjectStream
.ParagraphStream
(ObjectStream<String> lineStream) Initializes anFilterObjectStream
. -
Uses of ObjectStream in opennlp.tools.util.eval
Classes in opennlp.tools.util.eval that implement ObjectStreamModifier and TypeClassDescriptionstatic class
TheCrossValidationPartitioner.TrainingSampleStream
which iterates over all training elements.Methods in opennlp.tools.util.eval that return ObjectStreamModifier and TypeMethodDescriptionCrossValidationPartitioner.TrainingSampleStream.getTestSampleStream()
Retrieves theObjectStream
over the test/evaluations elements and poisons thisCrossValidationPartitioner.TrainingSampleStream
.Methods in opennlp.tools.util.eval with parameters of type ObjectStreamModifier and TypeMethodDescriptionvoid
Evaluator.evaluate
(ObjectStream<T> samples) Reads allsample objects
and evaluates each instance via theEvaluator.evaluateSample(Object)
method.Constructors in opennlp.tools.util.eval with parameters of type ObjectStreamModifierConstructorDescriptionCrossValidationPartitioner
(ObjectStream<E> inElements, int numberOfPartitions) InitializesCrossValidationPartitioner
instance.
SentenceDetectorME.train(String, ObjectStream, SentenceDetectorFactory, TrainingParameters)
and pass in afSentenceDetectorFactory
.