Examples of cascading.flow.tez.planner.rule.assertion.DualStreamedAccumulatedMergeNodeAssert

Package cascading.flow.tez.planner.rule.assertion

Examples of cascading.flow.tez.planner.rule.assertion.DualStreamedAccumulatedMergeNodeAssert

cascading.flow.tez.planner.rule.assertion.DualStreamedAccumulatedMergeNodeAssert
Throws a planner failure if a Tap, both accumulating and streamed, flows into a single merge within a given pipeline.
The optimization is to remove the streamed edge between tap and merge, but GraphFinder needs to support marking edges.


    // PostNodes
    addRule( new RemoveMalformedHashJoinNodeTransformer() ); // joinsIntoCoGroupLhs
    addRule( new AccumulatedPostNodeAnnotator() ); // allows accumulated boundaries to be identified


    addRule( new DualStreamedAccumulatedMergeNodeAssert() );
    }

View Full Code Here

TOP

Related Classes of cascading.flow.tez.planner.rule.assertion.DualStreamedAccumulatedMergeNodeAssert

cascading.flow.hadoop.planner.rule.expression.DualStreamedAccumulatedExpression

cascading.flow.tez.planner.HashJoinHadoop2TezRuleRegistry

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.