List of sourceConfInit() Examples

Examples of sourceConfInit()

cascading.scheme.Scheme.sourceConfInit()
Method sourceInit initializes this instance as a source.
This method is executed client side as a means to provide necessary configuration parameters used by the underlying platform.
It is not intended to initialize resources that would be necessary during the execution of this class, like a "formatter" or "parser".
See {@link #sourcePrepare(cascading.flow.FlowProcess,SourceCall)} if resources much be initializedbefore use. And {@link #sourceCleanup(cascading.flow.FlowProcess,SourceCall)} if resources must bedestroyed after use. @param flowProcess of type FlowProcess @param tap of type Tap @param conf of type Config
cascading.tap.Tap.sourceConfInit()
Method sourceConfInit initializes this instance as a source.
This method maybe called more than once if this Tap instance is used outside the scope of a {@link cascading.flow.Flow}instance or if it participates in multiple times in a given Flow or across different Flows in a {@link cascading.cascade.Cascade}.
In the context of a Flow, it will be called after {@link cascading.flow.FlowListener#onStarting(cascading.flow.Flow)}
Note that no resources or services should be modified by this method. @param flowProcess of type FlowProcess @param conf of type Config

Examples of cascading.scheme.Scheme.sourceConfInit()

    public void testCreateScheme() throws IOException {
        Scheme scheme = factory.createScheme(new Fields(), new Properties());
        assertThat(scheme, notNullValue());


        try {
            scheme.sourceConfInit(null, null, null);
            fail();
        } catch (UnsupportedOperationException ex) {
        }


        try {

View Full Code Here

Examples of cascading.tap.Tap.sourceConfInit()


    // set the combine flag
    conf.setBoolean( HfsProps.COMBINE_INPUT_FILES, true );


    // test the input format and the split
    source.sourceConfInit( process, conf );


    InputFormat inputFormat = conf.getInputFormat();


    assertEquals( Hfs.CombinedInputFormat.class, inputFormat.getClass() );
    InputSplit[] splits = inputFormat.getSplits( conf, 1 );

View Full Code Here

Examples of cascading.tap.Tap.sourceConfInit()

        Tap tap = (Tap) element;


        if( tap.getIdentifier() == null )
          throw new IllegalStateException( "tap may not have null identifier: " + tap.toString() );


        tap.sourceConfInit( flowProcess, current );


        Map<String, String> map = flowProcess.diffConfigIntoMap( new TezConfiguration( conf ), new TezConfiguration( current ) );
        conf.set( "cascading.node.accumulated.source.conf." + Tap.id( tap ), pack( map, conf ) );


        setLocalMode( conf, current, tap );

View Full Code Here

Examples of cascading.tap.Tap.sourceConfInit()

        Tap tap = (Tap) element;


        if( tap.getIdentifier() == null )
          throw new IllegalStateException( "tap may not have null identifier: " + tap.toString() );


        tap.sourceConfInit( flowProcess, current );


        setLocalMode( conf, current, tap );
        }


      String id = FlowElements.id( element );

View Full Code Here

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.