Examples of ChunkData

org.apache.stanbol.enhancer.engines.entitylinking.impl.ChunkData

Represents a Chunk (group of tokens) used as context for EntityLinking. Typically a single {@link ChunkData#chunk} is used, but in case ofoverlapping and {@link ChunkData#isProcessable processable} chunksmultiple {@link Chunk}s might be merged to a single {@link ChunkData}instance. In such cases {@link ChunkData#chunk} represents thefirst and {@link ChunkData#merged} the last of the merged chunks.

{@link ChunkData#startToken} and {@link ChunkData#endToken} representthe covered [start,end) {@link Token} indices relative to the currentsections (typically a {@link Sentence}). {@link ChunkData#getStartChar()}and {@link ChunkData#getEndChar()} are the absolute [start,end) characterindices within the {@link AnalysedText#getSpan()}

se.llbit.chunky.world.ChunkData

@author Jesper Öqvist

                    log.trace(" > reduce tag {} - no overlapp with linkable token", tagSequence);
                }
            } else { //if the tag overlaps a linkable token 
                TokenData linkableToken = linkableTokenContext.linkableToken;
                List<TokenData> tokens = linkableTokenContext.context;
                ChunkData cd = linkableToken.inChunk; //check if it maches > 50% of the chunk
                 if(!lpc.isIgnoreChunks() && cd != null &&
                        cd.isProcessable){
                    int cstart = cd.getMatchableStartChar() >= 0 ? cd.getMatchableStartChar() :
                        start;
                    int cend = cd.getMatchableEndChar();
                    if(cstart < start || cend > end){ //if the tag does not cover the whole chunk
                        int num = 0;
                        int match = 0;
                        for(int i = cd.getMatchableStart(); i <= cd.getMatchableEnd(); i++){
                            TokenData td = tokens.get(i);
                            if(td.isMatchable){
                                num++;
                                if(match < 1 && td.token.getStart() >= start ||
                                        match > 0 && td.token.getEnd() <= end){

    try {
      if (m.matches()) {
        filename = m.group(3);
        int x = Integer.parseInt(m.group(1));
        int z = Integer.parseInt(m.group(2));
        ChunkData data = Region.getChunkData(new File(filename),
          ChunkPosition.get(x, z));
        if (data == null) {
          System.err.println("No such chunk in region: (" + x + "," + z + ")");
          return new ErrorTag();
        }

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.

Examples of ChunkData

Examples of org.apache.stanbol.enhancer.engines.entitylinking.impl.ChunkData

Examples of se.llbit.chunky.world.ChunkData