Stanford NLP で英語キーワードの原型などを取得する

ソースコード

import java.util.List;
import java.util.Properties;

import edu.stanford.nlp.ling.CoreAnnotations.LemmaAnnotation;
import edu.stanford.nlp.ling.CoreAnnotations.NamedEntityTagAnnotation;
import edu.stanford.nlp.ling.CoreAnnotations.PartOfSpeechAnnotation;
import edu.stanford.nlp.ling.CoreAnnotations.TextAnnotation;
import edu.stanford.nlp.ling.CoreAnnotations.TokensAnnotation;
import edu.stanford.nlp.ling.CoreLabel;
import edu.stanford.nlp.pipeline.Annotation;
import edu.stanford.nlp.pipeline.StanfordCoreNLP;

public class App {
	public static void main(String[] args) {
		String text = "Nissan Motor Co., Ltd is a Japanese multinational automobile manufacture headquartered in Yokohama.";
		Properties properties = new Properties();
		properties.setProperty("annotators", "tokenize,ssplit,pos,lemma,ner");

		StanfordCoreNLP coreNLP = new StanfordCoreNLP(properties);

		Annotation annotation = new Annotation(text);
		coreNLP.annotate(annotation);

		List<CoreLabel> labels = annotation.get(TokensAnnotation.class);

		System.err.println("Text,POS,Lemma,NE");

		for (CoreLabel label : labels) {
			System.err.println(label.get(TextAnnotation.class) + ":" //
					+ label.get(PartOfSpeechAnnotation.class) + ":" //
					+ label.get(LemmaAnnotation.class) + ":" //
					+ label.get(NamedEntityTagAnnotation.class) + ":" //
			);
		}

	}
}

出力結果

Text,POS,Lemma,NE
Nissan:NNP:Nissan:ORGANIZATION:
Motor:NNP:Motor:ORGANIZATION:
Co.:NNP:Co.:ORGANIZATION:
,:,:,:O:
Ltd:NNP:Ltd:ORGANIZATION:
is:VBZ:be:O:
a:DT:a:O:
Japanese:JJ:japanese:MISC:
multinational:JJ:multinational:O:
automobile:NN:automobile:O:
manufacture:NN:manufacture:O:
headquartered:VBN:headquarter:O:
in:IN:in:O:
Yokohama:NNP:Yokohama:LOCATION:
.:.:.:O:

結果表

結果を表にすると以下の通り。

Text	POS	Lemma	NE
Nissan	NNP	Nissan	ORGANIZATION
Motor	NNP	Motor	ORGANIZATION
Co.	NNP	Co.	ORGANIZATION
,	,	,	O
Ltd	NNP	Ltd	ORGANIZATION
is	VBZ	be	O
a	DT	a	O
Japanese	JJ	japanese	MISC
multinational	JJ	multinational	O
automobile	NN	automobile	O
manufacture	NN	manufacture	O
headquartered	VBN	headquarter	O
in	IN	in	O
Yokohama	NNP	Yokohama	LOCATION
.	.	.	O