Examples of LogicalNode

com.cloudera.flume.agent.LogicalNode
This is a logical node. This contains state about a node, it does not have any specific RPC mechanism associated with it. TODO (jon) this is a slight lie, FlumeConfigData is a thrift generate struct. Here is how a configuration is loaded, and where errors are handled: A call to checkConfig triggers a logicalNode update check based on info provided by FlumeConfigData for the logical node. It is assumed that there are not multiple concurrent checkConfig calls. If the config needs to be updated, the logical node updates itself via loadConfig. If there is a previous configuration the driver, its source and its sink is first closed. Configuration for a source and a sink are instantiated and then instantiated into a new Driver. Any parsing/instantiation failures exit by throwing exceptions. Currently a separate thread is used to reconfigure a node. A previous patch made the logicalNode lazily open the source and sinks. This defers real open errors into the main driver thread. This actually differs any open exceptions into the driver thread which is actually a simplifies error handling. An instantiated driver that pulls events out of the sources and into the sink. Run this until an unhandled exception occurs or the source exits with null signaling that it has been completely drained. TODO (jon) This class is not consistently synchronized currently. Another look at this code may be necessary.
org.apache.tajo.engine.planner.logical.LogicalNode

Examples of org.apache.tajo.engine.planner.logical.LogicalNode

  };


  @Test
  public final void testLeftOuterHashJoinExec0() throws IOException, PlanningException {
    Expr expr = analyzer.parse(QUERIES[0]);
    LogicalNode plan = planner.createPlan(expr).getRootBlock().getRoot();
    JoinNode joinNode = PlannerUtil.findTopNode(plan, NodeType.JOIN);
    Enforcer enforcer = new Enforcer();
    enforcer.enforceJoinAlgorithm(joinNode.getPID(), JoinAlgorithm.IN_MEMORY_HASH_JOIN);


    Fragment[] dep3Frags = StorageManager.splitNG(conf, "dep3", dep3.getMeta(), dep3.getPath(), Integer.MAX_VALUE);

View Full Code Here

Examples of org.apache.tajo.engine.planner.logical.LogicalNode


    Path workDir = CommonTestingUtil.getTestDir("target/test-data/TestLeftOuter_HashJoinExec1");
    TaskAttemptContext ctx = new TaskAttemptContext(conf,
        LocalTajoTestingUtility.newQueryUnitAttemptId(), merged, workDir);
    Expr expr = analyzer.parse(QUERIES[1]);
    LogicalNode plan = planner.createPlan(expr).getRootBlock().getRoot();


    PhysicalPlanner phyPlanner = new PhysicalPlannerImpl(conf, sm);
    PhysicalExec exec = phyPlanner.createPlan(ctx, plan);


    ProjectionExec proj = (ProjectionExec) exec;

View Full Code Here

Examples of org.apache.tajo.engine.planner.logical.LogicalNode


    Path workDir = CommonTestingUtil.getTestDir("target/test-data/TestLeftOuter_HashJoinExec2");
    TaskAttemptContext ctx = new TaskAttemptContext(conf,
        LocalTajoTestingUtility.newQueryUnitAttemptId(), merged, workDir);
    Expr expr = analyzer.parse(QUERIES[2]);
    LogicalNode plan = planner.createPlan(expr).getRootBlock().getRoot();


    PhysicalPlanner phyPlanner = new PhysicalPlannerImpl(conf, sm);
    PhysicalExec exec = phyPlanner.createPlan(ctx, plan);


    ProjectionExec proj = (ProjectionExec) exec;

View Full Code Here

Examples of org.apache.tajo.engine.planner.logical.LogicalNode


    Path workDir = CommonTestingUtil.getTestDir("target/test-data/TestLeftOuter_HashJoinExec3");
    TaskAttemptContext ctx = new TaskAttemptContext(conf,
        LocalTajoTestingUtility.newQueryUnitAttemptId(), merged, workDir);
    Expr expr = analyzer.parse(QUERIES[3]);
    LogicalNode plan = planner.createPlan(expr).getRootBlock().getRoot();


    PhysicalPlanner phyPlanner = new PhysicalPlannerImpl(conf, sm);
    PhysicalExec exec = phyPlanner.createPlan(ctx, plan);


    ProjectionExec proj = (ProjectionExec) exec;

View Full Code Here

Examples of org.apache.tajo.engine.planner.logical.LogicalNode


    Path workDir = CommonTestingUtil.getTestDir("target/test-data/TestLeftOuter_HashJoinExec4");
    TaskAttemptContext ctx = new TaskAttemptContext(conf,
        LocalTajoTestingUtility.newQueryUnitAttemptId(), merged, workDir);
    Expr expr = analyzer.parse(QUERIES[4]);
    LogicalNode plan = planner.createPlan(expr).getRootBlock().getRoot();


    PhysicalPlanner phyPlanner = new PhysicalPlannerImpl(conf, sm);
    PhysicalExec exec = phyPlanner.createPlan(ctx, plan);


    ProjectionExec proj = (ProjectionExec) exec;

View Full Code Here

Examples of org.apache.tajo.engine.planner.logical.LogicalNode

    ctx.setEnforcer(new Enforcer());
    Expr expr = analyzer.parse(QUERIES[0]);
    LogicalPlan plan = planner.createPlan(expr);
    optimizer.optimize(plan);
    System.out.println(plan);
    LogicalNode rootNode = plan.getRootBlock().getRoot();


    PhysicalPlanner phyPlanner = new PhysicalPlannerImpl(conf, sm);
    PhysicalExec exec = phyPlanner.createPlan(ctx, rootNode);


    // replace an equal join with an hash anti join.

View Full Code Here

Examples of org.apache.tajo.engine.planner.logical.LogicalNode

  };


  @Test
  public final void testRightOuterMergeJoin0() throws IOException, PlanningException {
    Expr expr = analyzer.parse(QUERIES[0]);
    LogicalNode plan = planner.createPlan(expr).getRootBlock().getRoot();
    JoinNode joinNode = PlannerUtil.findTopNode(plan, NodeType.JOIN);
    Enforcer enforcer = new Enforcer();
    enforcer.enforceJoinAlgorithm(joinNode.getPID(), JoinAlgorithm.MERGE_JOIN);


    Fragment[] emp3Frags = StorageManager.splitNG(conf, "emp3", emp3.getMeta(), emp3.getPath(), Integer.MAX_VALUE);

View Full Code Here

Examples of org.apache.tajo.engine.planner.logical.LogicalNode




  @Test
  public final void testRightOuter_MergeJoin1() throws IOException, PlanningException {
    Expr expr = analyzer.parse(QUERIES[1]);
    LogicalNode plan = planner.createPlan(expr).getRootBlock().getRoot();
    JoinNode joinNode = PlannerUtil.findTopNode(plan, NodeType.JOIN);
    Enforcer enforcer = new Enforcer();
    enforcer.enforceJoinAlgorithm(joinNode.getPID(), JoinAlgorithm.MERGE_JOIN);


    Fragment[] emp3Frags = StorageManager.splitNG(conf, "emp3", emp3.getMeta(), emp3.getPath(), Integer.MAX_VALUE);

View Full Code Here

Examples of org.apache.tajo.engine.planner.logical.LogicalNode

  }


  @Test
  public final void testRightOuterMergeJoin2() throws IOException, PlanningException {
    Expr expr = analyzer.parse(QUERIES[2]);
    LogicalNode plan = planner.createPlan(expr).getRootBlock().getRoot();
    JoinNode joinNode = PlannerUtil.findTopNode(plan, NodeType.JOIN);
    Enforcer enforcer = new Enforcer();
    enforcer.enforceJoinAlgorithm(joinNode.getPID(), JoinAlgorithm.MERGE_JOIN);


    Fragment[] emp3Frags = StorageManager.splitNG(conf, "emp3", emp3.getMeta(), emp3.getPath(), Integer.MAX_VALUE);

View Full Code Here

Examples of org.apache.tajo.engine.planner.logical.LogicalNode




  @Test
  public final void testRightOuter_MergeJoin3() throws IOException, PlanningException {
    Expr expr = analyzer.parse(QUERIES[3]);
    LogicalNode plan = planner.createPlan(expr).getRootBlock().getRoot();
    JoinNode joinNode = PlannerUtil.findTopNode(plan, NodeType.JOIN);
    Enforcer enforcer = new Enforcer();
    enforcer.enforceJoinAlgorithm(joinNode.getPID(), JoinAlgorithm.MERGE_JOIN);


    Fragment[] emp3Frags = StorageManager.splitNG(conf, "emp3", emp3.getMeta(), emp3.getPath(), Integer.MAX_VALUE);

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.