Examples of OutputCollector

backtype.storm.task.OutputCollector
This output collector exposes the API for emitting tuples from an IRichBolt. This is the core API for emitting tuples. For a simpler API, and a more restricted form of stream processing, see IBasicBolt and BasicOutputCollector.
com.btaz.datautil.files.mapreduce.OutputCollector
User: msundell
com.btaz.util.mr.OutputCollector
User: msundell
org.apache.hadoop.mapred.OutputCollector
Collects the <key, value> pairs output by {@link Mapper}s and {@link Reducer}s.
OutputCollector is the generalization of the facility provided by the Map-Reduce framework to collect data output by either the Mapper or the Reducer i.e. intermediate outputs or the output of the job.

Examples of backtype.storm.task.OutputCollector


    IOutputCollector output_collector = new BoltCollector(
        message_timeout_secs, _report_error, _send_fn, _transfer_fn,
        _topology_context, task_id, tuple_start_times, _task_stats);
    LOG.info("Preparing bolt " + component_id + ":" + task_id);
    bolt.prepare(storm_conf, _user_context, new OutputCollector(
        output_collector));
    LOG.info("Prepared bolt " + component_id + ":" + task_id);
    deserializer = new KryoTupleDeserializer(storm_conf, _topology_context);


  }

View Full Code Here

Examples of backtype.storm.task.OutputCollector

        if(_delegate instanceof TimeoutCallback) {
            callback = new TimeoutItems();
        }
        _tracked = new TimeCacheMap<Object, TrackingInfo>(context.maxTopologyMessageTimeout(config), callback);
        _collector = collector;
        _delegate.prepare(config, context, new OutputCollector(new CoordinatedOutputCollector(collector)));
        for(String component: Utils.get(context.getThisTargets(),
                                        Constants.COORDINATED_STREAM_ID,
                                        new HashMap<String, Grouping>())
                                        .keySet()) {
            for(Integer task: context.getComponentTasks(component)) {

View Full Code Here

Examples of backtype.storm.task.OutputCollector

    // given
    Tuple tickTuple = MockTupleHelpers.mockTickTuple();
    RollingCountBolt bolt = new RollingCountBolt();
    Map conf = mock(Map.class);
    TopologyContext context = mock(TopologyContext.class);
    OutputCollector collector = mock(OutputCollector.class);
    bolt.prepare(conf, context, collector);


    // when
    bolt.execute(tickTuple);

View Full Code Here

Examples of backtype.storm.task.OutputCollector

    Tuple tickTuple = MockTupleHelpers.mockTickTuple();


    RollingCountBolt bolt = new RollingCountBolt();
    Map conf = mock(Map.class);
    TopologyContext context = mock(TopologyContext.class);
    OutputCollector collector = mock(OutputCollector.class);
    bolt.prepare(conf, context, collector);


    // when
    bolt.execute(normalTuple);
    bolt.execute(tickTuple);

View Full Code Here

Examples of backtype.storm.task.OutputCollector

        Properties props = new Properties();
        props.put("metadata.broker.list", broker.getBrokerConnectionString());
        props.put("request.required.acks", "1");
        props.put("serializer.class", "kafka.serializer.StringEncoder");
        config.put(KafkaBolt.KAFKA_BROKER_PROPERTIES, props);
        bolt.prepare(config, null, new OutputCollector(collector));
        return bolt;
    }

View Full Code Here

Examples of backtype.storm.task.OutputCollector

        KafkaBolt bolt = new KafkaBolt();
        Properties props = new Properties();
        props.put("metadata.broker.list", broker.getBrokerConnectionString());
        props.put("request.required.acks", "1");
        config.put(KafkaBolt.KAFKA_BROKER_PROPERTIES, props);
        bolt.prepare(config, null, new OutputCollector(collector));
        return bolt;
    }

View Full Code Here

Examples of backtype.storm.task.OutputCollector

        Properties props = new Properties();
        props.put("metadata.broker.list", broker.getBrokerConnectionString());
        props.put("request.required.acks", "1");
        props.put("serializer.class", "kafka.serializer.StringEncoder");
        config.put(KafkaBolt.KAFKA_BROKER_PROPERTIES, props);
        bolt.prepare(config, null, new OutputCollector(collector));
        return bolt;
    }

View Full Code Here

Examples of backtype.storm.task.OutputCollector

        KafkaBolt bolt = new KafkaBolt();
        Properties props = new Properties();
        props.put("metadata.broker.list", broker.getBrokerConnectionString());
        props.put("request.required.acks", "1");
        config.put(KafkaBolt.KAFKA_BROKER_PROPERTIES, props);
        bolt.prepare(config, null, new OutputCollector(collector));
        return bolt;
    }

View Full Code Here

Examples of backtype.storm.task.OutputCollector

    // given
    Tuple tickTuple = MockTupleHelpers.mockTickTuple();
    RollingCountBolt bolt = new RollingCountBolt();
    Map conf = mock(Map.class);
    TopologyContext context = mock(TopologyContext.class);
    OutputCollector collector = mock(OutputCollector.class);
    bolt.prepare(conf, context, collector);


    // when
    bolt.execute(tickTuple);

View Full Code Here

Examples of backtype.storm.task.OutputCollector

    Tuple tickTuple = MockTupleHelpers.mockTickTuple();


    RollingCountBolt bolt = new RollingCountBolt();
    Map conf = mock(Map.class);
    TopologyContext context = mock(TopologyContext.class);
    OutputCollector collector = mock(OutputCollector.class);
    bolt.prepare(conf, context, collector);


    // when
    bolt.execute(normalTuple);
    bolt.execute(tickTuple);

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.