Examples of org.apache.stanbol.enhancer.nlp.model.Section.addToken()

Package org.apache.stanbol.enhancer.nlp.model

Class org.apache.stanbol.enhancer.nlp.model.Section

Examples of org.apache.stanbol.enhancer.nlp.model.Section.addToken()

org.apache.stanbol.enhancer.nlp.model.Section.addToken()
Adds an Token relative to this Sentence @param start the start of the token relative to the sentence @param end @return

        while(sections.hasNext()){
            Section section = sections.next();
            //Tokenize section
            opennlp.tools.util.Span[] tokenSpans = tokenizer.tokenizePos(section.getSpan());
            for(int i=0;i<tokenSpans.length;i++){
                Token token = section.addToken(tokenSpans[i].getStart(), tokenSpans[i].getEnd());
                log.trace(" > add {}",token);
            }
        }
    }

View Full Code Here

        while(sections.hasNext()){
            Section section = sections.next();
            //Tokenize section
            opennlp.tools.util.Span[] tokenSpans = tokenizer.tokenizePos(section.getSpan());
            for(int i=0;i<tokenSpans.length;i++){
                Token token = section.addToken(tokenSpans[i].getStart(), tokenSpans[i].getEnd());
                log.trace(" > add {}",token);
            }
        }
    }

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.