Examples of IndexBuilder

com.hp.hpl.jena.tdb.index.IndexBuilder
A policy holder for making indexes and range indexes.
index.IndexBuilder
Class responsible for creating an index for the given configuration @author rahul
it.unimi.di.big.mg4j.tool.IndexBuilder
it.unimi.dsi.mg4j.tool.IndexBuilder
An index builder.
An instance of this class exposes a {@link #run()} methodthat will index the {@link DocumentSequence} provided at construction timeby calling {@link Scan} and {@link Combine} in sequence.
Additionally, a main method provides easy access to index construction.
All indexing parameters are available either as chainable setters that can be called optionally before invoking {@link #run()}, or as public mutable collections and maps. For instance,
```
 new IndexBuilder( "foo", sequence ).skips( true ).run(); 
```
will build an index with basename foo using skips. If instead we want to index just the first field of the sequence, and use a {@link ShiftAddXorSignedStringMap}as a term map, we can use the following code:
```
 new IndexBuilder( "foo", sequence ) .termMapClass( ShiftAddXorSignedMinimalPerfectHash.class ) .indexedFields( 0 ).run(); 
```
More sophisticated modifications can be applied using public maps:
```
 IndexBuilder indexBuilder = new IndexBuilder( "foo", sequence ); indexBuilder.virtualDocumentGaps.put( 0, 30 ); indexBuilder.virtualDocumentResolver.put( 0, someVirtualDocumentResolver ); indexBuilder.run(); 
```

Examples of com.hp.hpl.jena.tdb.index.IndexBuilder

    
    /** Create a graph backed with storage at a location using B+Tree indexes (testing) */
    public static GraphTDB createBPlusTree(Location location)
    { 
        IndexFactoryBPlusTree idxFactory = new IndexFactoryBPlusTree(SystemTDB.BlockSizeTest) ;
        IndexBuilder builder = new IndexBuilder(idxFactory,idxFactory) ; 
        return FactoryGraphTDB.createGraph(builder, location) ;
    }

View Full Code Here

Examples of com.hp.hpl.jena.tdb.index.IndexBuilder


    /** Create a graph backed with storage and B+Tree indexes in-memory (testing) */
    public static GraphTDB createBPlusTreeMem()
    { 
        IndexFactoryBPlusTree idxFactory = new IndexFactoryBPlusTree(SystemTDB.BlockSizeTestMem) ;
        IndexBuilder builder = new IndexBuilder(idxFactory,idxFactory) ; 
        return FactoryGraphTDB.createGraphMem(builder) ;
    }

View Full Code Here

Examples of com.hp.hpl.jena.tdb.index.IndexBuilder

    
    /** Create a graph backed with storage at a location using B+Tree indexes (testing) */
    public static GraphTriplesTDB createBPlusTree(Location location)
    { 
        IndexFactoryBPlusTree idxFactory = new IndexFactoryBPlusTree(SystemTDB.BlockSizeTest) ;
        IndexBuilder builder = new IndexBuilder(idxFactory,idxFactory) ; 
        return FactoryGraphTDB.createGraph(builder, location) ;
    }

View Full Code Here

Examples of com.hp.hpl.jena.tdb.index.IndexBuilder


    /** Create a graph backed with storage and B+Tree indexes in-memory (testing) */
    public static GraphTriplesTDB createBPlusTreeMem()
    { 
        IndexFactoryBPlusTree idxFactory = new IndexFactoryBPlusTree(SystemTDB.BlockSizeTestMem) ;
        IndexBuilder builder = new IndexBuilder(idxFactory,idxFactory) ; 
        return FactoryGraphTDB.createGraphMem(builder) ;
    }

View Full Code Here

Examples of index.IndexBuilder

public class IndexBuilderMojo extends ApplicationLoader {
    Log log = LogFactory.getLog(IndexBuilderMojo.class);


    public void execute() throws MojoExecutionException {
        Application application = this.loadApplication();
        IndexBuilder indexBuilder = application.<IndexBuilder> getInstance(IndexBuilder.class);
        indexBuilder.buildIndex();
    }

View Full Code Here

Examples of it.unimi.di.big.mg4j.tool.IndexBuilder

        documentSequence = Scan.getSequence(sequence,
                IdentityDocumentFactory.class, new String[] {},
                Scan.DEFAULT_DELIMITER, LOGGER);


        LOGGER.info(String.format("Term processor class is %s", termProcessor.getClass()));
        IndexBuilder indexBuilder = new IndexBuilder(new File(directory,basename).getAbsolutePath(), documentSequence);
        indexBuilder.termProcessor(termProcessor).documentsPerBatch(
                documentsPerBatch);


        if (tmpDirectory != null)
            indexBuilder.batchDirName(tmpDirectory.getAbsolutePath());


        indexBuilder.run();
        return 0;
    }

View Full Code Here

Examples of it.unimi.dsi.mg4j.tool.IndexBuilder

  private String basename;


  @Override
  public void setUp() throws ConfigurationException, SecurityException, IOException, URISyntaxException, ClassNotFoundException, InstantiationException, IllegalAccessException, InvocationTargetException, NoSuchMethodException {
    basename = File.createTempFile( getClass().getSimpleName(), "test" ).getCanonicalPath();
    new IndexBuilder( basename, new StringArrayDocumentCollection( "a", "b", "c" ) ).run();
    index = DiskBasedIndex.getInstance( basename + "-text", true, true );
  }

View Full Code Here

Examples of it.unimi.dsi.mg4j.tool.IndexBuilder

  private Object2ReferenceMap<String, Index> indexMap;


  @Override
  public void setUp() throws ConfigurationException, SecurityException, IOException, URISyntaxException, ClassNotFoundException, InstantiationException, IllegalAccessException, InvocationTargetException, NoSuchMethodException {
    basename = File.createTempFile( getClass().getSimpleName(), "test" ).getCanonicalPath();
    new IndexBuilder( basename + "0", new StringArrayDocumentCollection( "a b", "b c", "c" ) ).run();
    new IndexBuilder( basename + "1", new StringArrayDocumentCollection( "a b", "b c", "c" ) ).run();
    index0 = DiskBasedIndex.getInstance( basename + "0-text", true, true );
    index1 = DiskBasedIndex.getInstance( basename + "1-text", true, true );
    index2 = DiskBasedIndex.getInstance( basename + "0-text", true, true );
    index3 = DiskBasedIndex.getInstance( basename + "1-text", true, true );
    indexMap = new Object2ReferenceOpenHashMap<String, Index>( new String[] { "index0", "index1", "index2", "index3" }, new Index[] { index0, index1, index2, index3 } );

View Full Code Here

Examples of it.unimi.dsi.mg4j.tool.IndexBuilder

  private BitStreamIndex index;
  private SimpleParser simpleParser;
  public void setUp() throws ConfigurationException, SecurityException, IOException, URISyntaxException, ClassNotFoundException, InstantiationException, IllegalAccessException, InvocationTargetException, NoSuchMethodException {


    String basename = File.createTempFile( getClass().getSimpleName(), "test" ).getCanonicalPath();
    new IndexBuilder( basename, new StringArrayDocumentCollection( "a", "b", "c" ) ).run();
    index = DiskBasedIndex.getInstance( basename + "-text", true, true );
    simpleParser = new SimpleParser( index.termProcessor );
  }

View Full Code Here

Examples of it.unimi.dsi.mg4j.tool.IndexBuilder

  }
  
  // Contributed by Fabien Campagne
  public void testMG4JMultiTermPositionIssue() throws IllegalAccessException, NoSuchMethodException, ConfigurationException, IOException, InvocationTargetException, InstantiationException, ClassNotFoundException, URISyntaxException {
    String basename = File.createTempFile( getClass().getSimpleName(), "test" ).getCanonicalPath();
    new IndexBuilder( basename, new StringArrayDocumentCollection(
                "A B C D E F F G G",
                "G A T H S K L J W L",
                "E S K D L J F K L S J D L S J D",
                "E B"
    ) ).run();

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.