Package org.apache.nutch.fetcher

Examples of org.apache.nutch.fetcher.FetchEntry


   
    int partitionFromRef = refPartitioner.getPartition("http://www.example.org/", numReduceTasks);
    IntWritable intWritable = new IntWritable(1337); //doesn't matter
    WebPage page = new WebPage();
    String key = TableUtil.reverseUrl("http://www.example.org/");
    FetchEntry fetchEntry = new FetchEntry(conf, key, page);
    int partitionFromSig = sigPartitioner.getPartition(intWritable, fetchEntry, numReduceTasks);
   
    assertEquals("partitions should be same",
        partitionFromRef, partitionFromSig);
   
View Full Code Here


   
    int partitionFromRef = refPartitioner.getPartition("http://www.example.org/", numReduceTasks);
    IntWritable intWritable = new IntWritable(1337); //doesn't matter
    WebPage page = new WebPage();
    String key = TableUtil.reverseUrl("http://www.example.org/");
    FetchEntry fetchEntry = new FetchEntry(conf, key, page);
    int partitionFromSig = sigPartitioner.getPartition(intWritable, fetchEntry, numReduceTasks);
   
    assertEquals("partitions should be same",
        partitionFromRef, partitionFromSig);
   
View Full Code Here

TOP

Related Classes of org.apache.nutch.fetcher.FetchEntry

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.