com.northconcepts.datapipeline.transform

Class Ngrams

java.lang.Object

com.northconcepts.datapipeline.transform.Transformer

com.northconcepts.datapipeline.transform.Ngrams

public class Ngrams
extends Transformer

Extracts each run/sequence of N words from the source field and stores them in a target field as an array. See n-gram, Bigrams, and Trigrams for more details.

Constructor Summary

Constructors

Constructor and Description
Ngrams(String sourceFieldPath, String targetFieldPath, int ngramCount)
Ngrams(String sourceFieldPath, String targetFieldPath, int ngramCount, Locale locale)

Method Summary

Modifier and Type	Method and Description
String	toString()
boolean	transform(Record record)

Methods inherited from class com.northconcepts.datapipeline.transform.Transformer

addExceptionProperties, close, geEndpoint, getEndpoint, getReader, getWriter, open, setWriter

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Ngrams

public Ngrams(String sourceFieldPath,
              String targetFieldPath,
              int ngramCount,
              Locale locale)

Ngrams

public Ngrams(String sourceFieldPath,
              String targetFieldPath,
              int ngramCount)

Method Detail

transform

public boolean transform(Record record)
                  throws Throwable

Specified by:

transform in class Transformer

Throws:

Throwable

toString

public String toString()

Overrides:

toString in class Object