Examples of org.apache.hadoop.mapreduce.lib.input.FileInputFormat

Package org.apache.hadoop.mapreduce.lib.input

Examples of org.apache.hadoop.mapreduce.lib.input.FileInputFormat

org.apache.hadoop.mapreduce.lib.input.FileInputFormat
A base class for file-based {@link InputFormat}s.
FileInputFormat is the base class for all file-based InputFormats. This provides a generic implementation of {@link #getSplits(JobContext)}. Subclasses of FileInputFormat can also override the {@link #isSplitable(JobContext,Path)} method to ensure input-files arenot split-up and are processed as a whole by {@link Mapper}s.

                    outputFormat.getName()));
        }
        LOG.debug("Inferred opposite InputFormat: {}", inputFormatName);
        try {
            Class<?> loaded = outputFormat.getClassLoader().loadClass(inputFormatName);
            FileInputFormat instance = (FileInputFormat) ReflectionUtils.newInstance(loaded, conf);
            if (instance instanceof Configurable) {
                ((Configurable) instance).setConf(conf);
            }
            return instance;
        } catch (Exception e) {

View Full Code Here

        this.field = field;
    }


    @Override
    public InputFormat getInputFormat() throws IOException {
        return new FileInputFormat() {


            @Override
            public RecordReader createRecordReader(InputSplit split, TaskAttemptContext context) {
                return new HTTPConversationRecordReader(pathToTcp, field);
            }

View Full Code Here

import java.io.IOException;


public class FingerprintLoader extends PcapLoader {
    @Override
    public InputFormat getInputFormat() throws IOException {
        return new FileInputFormat() {
            @Override
            public RecordReader createRecordReader(InputSplit split, TaskAttemptContext context) {
                return new FingerprintRecordReader();
            }
        };

View Full Code Here

TOP

Related Classes of org.apache.hadoop.mapreduce.lib.input.FileInputFormat

com.asakusafw.testdriver.file.FileExporterRetriever

com.google.common.base.Stopwatch

com.packetloop.packetpig.loaders.pcap.detection.FingerprintLoader

com.packetloop.packetpig.loaders.pcap.protocol.HTTPConversationLoader

org.apache.hadoop.conf.Configuration

org.apache.hadoop.fs.BlockLocation

org.apache.hadoop.fs.FileSystem

org.apache.hadoop.fs.LocatedFileStatus

org.apache.hadoop.fs.Path

org.apache.hadoop.fs.PathFilter

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.