Package com.liveramp.cascading_ext.util

Examples of com.liveramp.cascading_ext.util.SimpleTupleMemoryUsageEstimator

72
73
74
75
76
77
78
79
80
81
82
    tc.close();

    Tap sink = new Hfs(new SequenceFile(new Fields("key", "sum")), OUTPUT_PATH);

    Pipe pipe = new Pipe("pipe");
    pipe = new Each(pipe, Combiner.function(new SimpleAggregator(), new Fields("key"), new Fields("value"), new Fields("sum"), MemoryBoundLruHashMap.UNLIMITED_ITEM_CAPACITY, 100, new SimpleTupleMemoryUsageEstimator(), new LongMemoryUsageEstimator(), false));

    CascadingUtil.get().getFlowConnector().connect(source, sink, pipe).complete();

    List<Tuple> tuples = getAllTuples(sink);
View Full Code Here
TOP

Related Classes of com.liveramp.cascading_ext.util.SimpleTupleMemoryUsageEstimator

  • com.liveramp.cascading_ext.combiner.TestCombiner
    • Copyright © 2018 www.massapicom. All rights reserved.
    All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.