Examples of org.apache.flink.api.java.record.io.CsvOutputFormat

Package org.apache.flink.api.java.record.io

Examples of org.apache.flink.api.java.record.io.CsvOutputFormat

org.apache.flink.api.java.record.io.CsvOutputFormat
This is an OutputFormat to serialize {@link Record}s to text. The output is structured by record delimiters and field delimiters as common in CSV files. Record delimiter separate records from each other ('\n' is common). Field delimiters separate fields within a record. Record and field delimiters can be configured using the CsvOutputFormat {@link Configuration}. The number of fields to serialize must be configured as well. For each field the type of the {@link Value} must be specified using the{@link CsvOutputFormat#FIELD_TYPE_PARAMETER_PREFIX} config key and an indexrunning from 0 to the number of fields. The position within the {@link Record} can be configured for each field usingthe {@link CsvOutputFormat#RECORD_POSITION_PARAMETER_PREFIX} config key.Either all {@link Record} positions must be configured or none. If none isconfigured, the index of the config key is used. @see Value @see Configuration @see Record

      .input(joinLiO)
      .name("AggLio")
      .build();


    // create DataSinkContract for writing the result
    FileDataSink result = new FileDataSink(new CsvOutputFormat(), output, aggLiO, "Output");
    CsvOutputFormat.configureRecordFormat(result)
      .recordDelimiter('\n')
      .fieldDelimiter('|')
      .lenient(true)
      .field(LongValue.class, 0)

View Full Code Here

    
    iteration.setNextWorkset(minAndUpdate);
    iteration.setSolutionSetDelta(minAndUpdate);


    // create DataSinkContract for writing the new cluster positions
    FileDataSink result = new FileDataSink(new CsvOutputFormat(), output, iteration, "Result");
    CsvOutputFormat.configureRecordFormat(result)
      .recordDelimiter('\n')
      .fieldDelimiter(' ')
      .field(LongValue.class, 0)
      .field(LongValue.class, 1);

View Full Code Here

0 1 2

TOP

Related Classes of org.apache.flink.api.java.record.io.CsvOutputFormat

org.apache.flink.addons.hbase.example.HBaseReadExample

org.apache.flink.hadoopcompatibility.mapred.record.example.WordCount

org.apache.flink.test.accumulators.AccumulatorIterativeITCase

org.apache.flink.test.broadcastvars.BroadcastVarsNepheleITCase

org.apache.flink.test.compiler.examples.WordCountCompilerTest

org.apache.flink.test.compiler.iterations.ConnectedComponentsTest

org.apache.flink.test.distributedCache.DistributedCacheTest

org.apache.flink.test.iterative.CoGroupConnectedComponentsITCase

org.apache.flink.test.iterative.ConnectedComponentsWithDeferredUpdateITCase

org.apache.flink.test.iterative.ConnectedComponentsWithSolutionSetFirstITCase

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.