Examples of org.apache.crunch.impl.mr.exec.MRExecutor

org.apache.crunch.impl.mr.exec.MRExecutor
Provides APIs for job control at runtime to clients. This class has a thread that submits jobs when they become ready, monitors the states of the running jobs, and updates the states of jobs based on the state changes of their depending jobs states. It is thread-safe.

          assignments.put(collect, proto);
        }
      }
    }


    MRExecutor exec = new MRExecutor(jarClass);
    for (JobPrototype proto : Sets.newHashSet(assignments.values())) {
      exec.addJob(proto.getCrunchJob(jarClass, conf, pipeline));
    }
    return exec;
  }

View Full Code Here

0 1

TOP

Related Classes of org.apache.crunch.impl.mr.exec.MRExecutor

org.apache.crunch.BreakpointIT

org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl

org.apache.crunch.impl.mr.MRPipeline

org.apache.crunch.impl.mr.plan.MSCRPlanner

org.apache.crunch.materialize.MaterializableIterable

org.apache.crunch.PipelineResult

org.apache.crunch.SourceTarget

org.apache.hadoop.conf.Configuration

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.