Package org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer

Examples of org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer.CombinerOptimizer.visit()


        boolean nocombiner = conf.getBoolean(PigConfiguration.PROP_NO_COMBINER, false);
        if (!pc.inIllustrator && !nocombiner)  {
            boolean doMapAgg = Boolean.parseBoolean(pc.getProperties().getProperty(
                    PigConfiguration.PROP_EXEC_MAP_PARTAGG, "false"));
            CombinerOptimizer co = new CombinerOptimizer(tezPlan, doMapAgg);
            co.visit();
            co.getMessageCollector().logMessages(MessageType.Warning, aggregateWarning, log);
        }

        // Run optimizer to make use of secondary sort key when possible for nested foreach
        // order by and distinct. Should be done before AccumulatorOptimizer
View Full Code Here


        if (!nocombiner) {
            boolean doMapAgg = Boolean.parseBoolean(pc.getProperties()
                    .getProperty(PigConfiguration.PROP_EXEC_MAP_PARTAGG,
                            "false"));
            CombinerOptimizer co = new CombinerOptimizer(tezPlan, doMapAgg);
            co.visit();
        }

        SecondaryKeyOptimizerTez skOptimizer = new SecondaryKeyOptimizerTez(
                tezPlan);
        skOptimizer.visit();
View Full Code Here

TOP
Copyright © 2018 www.massapi.com. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.