Package com.cloudera.recordbreaker.schemadict

Examples of com.cloudera.recordbreaker.schemadict.SchemaDictionary


   
      //
      // Build schema dictionary out of the "train" set
      //
      File dictDir = new File(workingDir, "dict");
      SchemaDictionary sd = new SchemaDictionary(dictDir);
      System.err.println("Building schema dictionary...");
      try {
        // Insert the files
        File targetList[] = trainDbDir.listFiles();
        for (int i = 0; i < targetList.length; i++) {
          File f = targetList[i];
          if (f.getName().endsWith(".avro")) {
            sd.addDictionaryElt(f, f.getName());
            if (i >= maxDictSize) {
              break;
            }
          }
        }
View Full Code Here

TOP

Related Classes of com.cloudera.recordbreaker.schemadict.SchemaDictionary

Copyright © 2018 www.massapicom. All rights reserved.
All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.