List of records() Examples

Examples of records()

com.cloudera.crunch.type.PTypeFamily.records()
com.foundationdb.server.test.it.keyupdate.CollectingIndexKeyVisitor.records()
smilehouse.util.csv.CSVReader.records()
Reads all available records from the Reader. Note that this method can be called only if the Reader hasn't been read already. @return All read records @throws IOException If there are problems reading the input with the given Reader. @throws CSVFormatException in case of malformed csv..

Examples of com.cloudera.crunch.type.PTypeFamily.records()


          void processingError(String line, @Nullable Throwable t) {
            super.getCounter(LogCounters.LOG_LINE_ERRORS).increment(1);
            log.error("Hit exception parsing line '" + line + "'", t);
          }
        }, tf.records(CommonLogEntry.class));
  }


}

View Full Code Here

Examples of com.cloudera.crunch.type.PTypeFamily.records()

        new DoFn<CommonLogEntry, Pair<String, CommonLogEntry>>() {
          @Override
          public void process(CommonLogEntry input, Emitter<Pair<String, CommonLogEntry>> emitter) {
            emitter.emit(Pair.of(input.getRemoteAddress(), input));
          }
        }, tf.tableOf(tf.strings(), tf.records(CommonLogEntry.class)));
  }


  public static PTable<String, String> ipsAndUsers(PCollection<String> ipUsers) {
    PTypeFamily tf = ipUsers.getTypeFamily();
    return ipUsers.parallelDo(

View Full Code Here

Examples of com.foundationdb.server.test.it.keyupdate.CollectingIndexKeyVisitor.records()

        Index pkIndex = getRowDef(rowDefId).getPKIndex();


        try(CloseableTransaction txn = txnService().beginCloseableTransaction(session())) {
            CollectingIndexKeyVisitor visitor = new CollectingIndexKeyVisitor();
            store().traverse(session(), pkIndex, visitor, -1, 0);
            assertEquals("traversed indexes", Arrays.asList(expectedIndexes), visitor.records());
            txn.commit();
        }
    }


    @Test

View Full Code Here

Examples of smilehouse.util.csv.CSVReader.records()

            new StringReader(data),
            csvRecordSeparatorChar,
            csvQuoteChar);


        try {
            csvResult = csvReader.records();
        } catch(CSVFormatException e) {
            logger.logMessage("Invalid data detected while reading CSV table, aborting", this, MessageLogger.ERROR);
            PipeComponentUtils.failTransfer();
        } catch(IOException e) {
            logger.logMessage("IOException while reading CSV table, aborting", this, MessageLogger.ERROR);

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.