Examples of PartitionKey

com.bazaarvoice.ostrich.partition.PartitionKey
com.cloudera.cdk.data.PartitionKey

A key for retrieving partitions from a {@link Dataset}.

A {@code PartitionKey} is a ordered sequence of values corresponding to the{@link FieldPartitioner}s in a {@link PartitionStrategy}. A {@link PartitionKey} may be obtained using{@link PartitionStrategy#partitionKey(Object)} or{@link PartitionStrategy#partitionKeyForEntity(Object)}.

Implementations of {@link PartitionKey} are typically not thread-safe; that is,the behavior when accessing a single instance from multiple threads is undefined.
@see PartitionStrategy @see FieldPartitioner @see Dataset
com.facebook.presto.spi.PartitionKey
com.mysql.clusterj.core.store.PartitionKey
This interface represents a partition key. A partition key consists of a table and values that make up the partition key. An instance of this interface can be used to specify the partition key used when starting a transaction.
org.kitesdk.data.spi.PartitionKey

A key for retrieving partitions from a {@link org.kitesdk.data.Dataset}.

A {@code PartitionKey} is an ordered sequence of values corresponding to the{@link org.kitesdk.data.spi.FieldPartitioner}s in a {@link org.kitesdk.data.PartitionStrategy}. You can obtain a {@link PartitionKey} using{@link PartitionKey#partitionKeyForEntity(org.kitesdk.data.PartitionStrategy,Object,EntityAccessor,PartitionKey)}.

Implementations of {@link PartitionKey} are typically not thread-safe; that is, the behavior when accessing a single instance from multiple threads is undefined.
@see org.kitesdk.data.PartitionStrategy @see org.kitesdk.data.spi.FieldPartitioner @see org.kitesdk.data.Dataset

Examples of com.mysql.clusterj.core.store.PartitionKey

    /** Create a partition key for a find by primary key. 
     * @param handler the handler that contains the values of the primary key
     */
    public PartitionKey createPartitionKey(ValueHandler handler) {
        // create the partition key based on the mapped table
        PartitionKey result = table.createPartitionKey();
        // add partition key part value for each partition key field
        for (DomainFieldHandler fmd: partitionKeyFieldHandlers) {
            if (logger.isDetailEnabled()) logger.detail(
                        "Field number " + fmd.getFieldNumber()
                        + " column name " + fmd.getName() + " field name " + fmd.getName());

View Full Code Here

Examples of com.mysql.clusterj.core.store.PartitionKey

     */
    private void setPartitionKey(DomainTypeHandler<?> domainTypeHandler,
            ValueHandler keyHandler) {
        if (!isEnlisted()) {
            // there is still time to set the partition key
            PartitionKey partitionKey = 
                domainTypeHandler.createPartitionKey(keyHandler);
            clusterTransaction.setPartitionKey(partitionKey);
        }
    }

View Full Code Here

Examples of org.kitesdk.data.spi.PartitionKey

          "FileSystemDataset. Dataset: " + dataset);
    }
    FileSystemDataset<E> fsDataset = (FileSystemDataset<E>) dataset;
    LOG.debug("Getting delegate input format for dataset {} with partition directory {}",
        dataset, partitionDir);
    PartitionKey key = fsDataset.keyFromDirectory(new Path(partitionDir));
    LOG.debug("Partition key: {}", key);
    if (key != null) {
      PartitionedDataset<E> partition = fsDataset.getPartition(key, false);
      LOG.debug("Partition: {}", partition);
      return getDelegateInputFormat(partition, conf);

View Full Code Here

Examples of org.kitesdk.data.spi.PartitionKey

      if (!(target instanceof FileSystemDataset)) {
        throw new UnsupportedOperationException("Partitions only supported for " +
            "FileSystemDataset. Dataset: " + target);
      }
      FileSystemDataset fsDataset = (FileSystemDataset) target;
      PartitionKey key = fsDataset.keyFromDirectory(new Path(partitionDir));
      if (key != null) {
        working = fsDataset.getPartition(key, true);
      }
      return new DatasetRecordWriter<E>(working);
    } else {

View Full Code Here

Examples of org.kitesdk.data.spi.PartitionKey


    for (int i = 0; i < size; i += 1) {
      values[i] = key.get(i);
    }


    return new PartitionKey(values);
  }

View Full Code Here

Examples of org.kitesdk.data.spi.PartitionKey

    partitionKeyForPath(dataset, new Path(testDirectory, "username_part").toUri());
  }


  @Test
  public void testValidPartition() throws Exception {
    PartitionKey key = partitionKeyForPath(dataset,
        new Path(testDirectory, "username_part=1").toUri());
    Assert.assertEquals(new PartitionKey(1), key);
  }

View Full Code Here

Examples of org.kitesdk.data.spi.PartitionKey

    Assert.assertTrue("Partitioned directory 0 exists",
      fileSystem.exists(new Path(testDirectory, "username_hash=0")));
    Assert.assertTrue("Partitioned directory 1 exists",
      fileSystem.exists(new Path(testDirectory, "username_hash=1")));
    checkTestUsers(ds, 10);
    PartitionKey key0 = new PartitionKey(0);
    PartitionKey key1 = new PartitionKey(1);
    int total = readTestUsersInPartition(ds, key0, null)
      + readTestUsersInPartition(ds, key1, null);
    Assert.assertEquals(10, total);


    testPartitionKeysAreEqual(ds, key0, key1);

View Full Code Here

Examples of org.kitesdk.data.spi.PartitionKey

    Assert.assertEquals(partitionStrategy, ds.getDescriptor()
      .getPartitionStrategy());


    writeTestUsers(ds, 10);
    checkTestUsers(ds, 10);
    PartitionKey key0 = new PartitionKey(0);
    PartitionKey key1 = new PartitionKey(1);
    int total = readTestUsersInPartition(ds, key0, "email_hash")
      + readTestUsersInPartition(ds, key0, "email_hash");
    Assert.assertEquals(10, total);


    total = 0;
    for (int i1 = 0; i1 < 2; i1++) {
      for (int i2 = 0; i2 < 3; i2++) {
        String part = "username_hash=" + i1 + "/email_hash=" + i2;
        Assert.assertTrue("Partitioned directory " + part + " exists",
          fileSystem.exists(new Path(testDirectory, part)));
        total += readTestUsersInPartition(ds,
          new PartitionKey(i1, i2), null);
      }
    }
    Assert.assertEquals(10, total);


    testPartitionKeysAreEqual(ds, key0, key1);

View Full Code Here

Examples of org.kitesdk.data.spi.PartitionKey

            .build())
        .type(Record.class)
        .build();


    Assert
      .assertNull(ds.getPartition(new PartitionKey(1), false));
  }

View Full Code Here

Examples of org.kitesdk.data.spi.PartitionKey

            .partitionStrategy(partitionStrategy)
            .build())
        .type(Record.class)
        .build();


    PartitionKey key = new PartitionKey(1);
    FileSystemDataset<Record> userPartition = (FileSystemDataset<Record>) ds.getPartition(key, true);
    Assert.assertEquals(key, userPartition.getPartitionKey());


    writeTestUsers(userPartition, 1);
    Assert.assertTrue("Partitioned directory exists",

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.