List of addDependentTask() Examples

Examples of addDependentTask()

org.apache.hadoop.hive.ql.exec.ConditionalTask.addDependentTask()
Add a dependent task on the current conditional task. The task will not be a direct child of conditional task. Actually it will be added as child task of associated tasks. @return true if the task got added false if it already existed
org.apache.hadoop.hive.ql.exec.DependencyCollectionTask.addDependentTask()
org.apache.hadoop.hive.ql.exec.MapredLocalTask.addDependentTask()
org.apache.hadoop.hive.ql.exec.mr.MapRedTask.addDependentTask()
org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask.addDependentTask()

Examples of org.apache.hadoop.hive.ql.exec.ConditionalTask.addDependentTask()

    
    List<Task<? extends Serializable>> mvTasks = ctx.getMvTask();
    Task<? extends Serializable> mvTask = findMoveTask(mvTasks, newOutput);
    
    if (mvTask != null)
      cndTsk.addDependentTask(mvTask);
  }
 
  private Task<? extends Serializable> findMoveTask(List<Task<? extends Serializable>> mvTasks, FileSinkOperator fsOp) {
    // find the move task
    for (Task<? extends Serializable> mvTsk : mvTasks) {

View Full Code Here

Examples of org.apache.hadoop.hive.ql.exec.ConditionalTask.addDependentTask()

    
    List<Task<? extends Serializable>> mvTasks = ctx.getMvTask();
    Task<? extends Serializable> mvTask = findMoveTask(mvTasks, newOutput);
    
    if (mvTask != null)
      cndTsk.addDependentTask(mvTask);
  }
 
  private Task<? extends Serializable> findMoveTask(List<Task<? extends Serializable>> mvTasks, FileSinkOperator fsOp) {
    // find the move task
    for (Task<? extends Serializable> mvTsk : mvTasks) {

View Full Code Here

Examples of org.apache.hadoop.hive.ql.exec.DependencyCollectionTask.addDependentTask()

      if (ctx.getConf().getBoolVar(ConfVars.HIVE_MULTI_INSERT_MOVE_TASKS_SHARE_DEPENDENCIES)) {
        DependencyCollectionTask dependencyTask = ctx.getDependencyTaskForMultiInsert();
        parentTask.addDependentTask(dependencyTask);
        if (mvTask.getWork().getLoadTableWork() != null) {
          // Moving tables/partitions depend on the dependencyTask
          dependencyTask.addDependentTask(mvTask);
        } else {
          // Moving files depends on the parentTask (we still want the dependencyTask to depend
          // on the parentTask)
          parentTask.addDependentTask(mvTask);
        }

View Full Code Here

Examples of org.apache.hadoop.hive.ql.exec.DependencyCollectionTask.addDependentTask()


        DependencyCollectionTask dependencyTask = ctx.getDependencyTaskForMultiInsert();
        parentTask.addDependentTask(dependencyTask);
        if (mvTask.getWork().getLoadTableWork() != null) {
          // Moving tables/partitions depend on the dependencyTask
          dependencyTask.addDependentTask(mvTask);
        } else {
          // Moving files depends on the parentTask (we still want the dependencyTask to depend
          // on the parentTask)
          parentTask.addDependentTask(mvTask);
        }

View Full Code Here

Examples of org.apache.hadoop.hive.ql.exec.DependencyCollectionTask.addDependentTask()

      if (ctx.getConf().getBoolVar(ConfVars.HIVE_MULTI_INSERT_MOVE_TASKS_SHARE_DEPENDENCIES)) {
        DependencyCollectionTask dependencyTask = ctx.getDependencyTaskForMultiInsert();
        parentTask.addDependentTask(dependencyTask);
        if (mvTask.getWork().getLoadTableWork() != null) {
          // Moving tables/partitions depend on the dependencyTask
          dependencyTask.addDependentTask(mvTask);
        } else {
          // Moving files depends on the parentTask (we still want the dependencyTask to depend
          // on the parentTask)
          parentTask.addDependentTask(mvTask);
        }

View Full Code Here

Examples of org.apache.hadoop.hive.ql.exec.DependencyCollectionTask.addDependentTask()

      if (ctx.getConf().getBoolVar(ConfVars.HIVE_MULTI_INSERT_MOVE_TASKS_SHARE_DEPENDENCIES)) {
        DependencyCollectionTask dependencyTask = ctx.getDependencyTaskForMultiInsert();
        parentTask.addDependentTask(dependencyTask);
        if (mvTask.getWork().getLoadTableWork() != null) {
          // Moving tables/partitions depend on the dependencyTask
          dependencyTask.addDependentTask(mvTask);
        } else {
          // Moving files depends on the parentTask (we still want the dependencyTask to depend
          // on the parentTask)
          parentTask.addDependentTask(mvTask);
        }

View Full Code Here

Examples of org.apache.hadoop.hive.ql.exec.MapredLocalTask.addDependentTask()

            }
          }
        }
        // make current task depends on this new generated localMapJoinTask
        // now localTask is the parent task of the current task
        localTask.addDependentTask(currTask);
      }
    }


    @Override
    public Object dispatch(Node nd, Stack<Node> stack, Object... nodeOutputs)

View Full Code Here

Examples of org.apache.hadoop.hive.ql.exec.MapredLocalTask.addDependentTask()

            }
          }
        }
        // make current task depends on this new generated localMapJoinTask
        // now localTask is the parent task of the current task
        localTask.addDependentTask(currTask);
      }
    }


    @Override
    public Object dispatch(Node nd, Stack<Node> stack, Object... nodeOutputs)

View Full Code Here

Examples of org.apache.hadoop.hive.ql.exec.mr.MapRedTask.addDependentTask()

            statsWork.setAggKey(op.getConf().getStatsAggPrefix());
            statsWork.setSourceTask(currTask);
            statsWork.setStatsReliable(parseCtx.getConf().getBoolVar(
                HiveConf.ConfVars.HIVE_STATS_RELIABLE));
            Task<StatsWork> statsTask = TaskFactory.get(statsWork, parseCtx.getConf());
            currTask.addDependentTask(statsTask);
            if (!ctx.getRootTasks().contains(currTask)) {
              ctx.getRootTasks().add(currTask);
            }


            // ANALYZE TABLE T [PARTITION (...)] COMPUTE STATISTICS noscan;

View Full Code Here

Examples of org.apache.hadoop.hive.ql.exec.mr.MapRedTask.addDependentTask()

            statsWork.setAggKey(op.getConf().getStatsAggPrefix());
            statsWork.setSourceTask(currTask);
            statsWork.setStatsReliable(parseCtx.getConf().getBoolVar(
                HiveConf.ConfVars.HIVE_STATS_RELIABLE));
            Task<StatsWork> statsTask = TaskFactory.get(statsWork, parseCtx.getConf());
            currTask.addDependentTask(statsTask);
            if (!ctx.getRootTasks().contains(currTask)) {
              ctx.getRootTasks().add(currTask);
            }


            // ANALYZE TABLE T [PARTITION (...)] COMPUTE STATISTICS noscan;

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.