Examples of org.apache.lucene.codecs.lucene42.Lucene42FieldInfosFormat

Package org.apache.lucene.codecs.lucene42

Examples of org.apache.lucene.codecs.lucene42.Lucene42FieldInfosFormat

org.apache.lucene.codecs.lucene42.Lucene42Codec
Lucene 4.2 Field Infos format.

Field names are stored in the field info file, with suffix .fnm.

FieldInfos (.fnm) --> Header,FieldsCount, <FieldName,FieldNumber, FieldBits,DocValuesBits,Attributes> ^FieldsCount

Data types:
- Header --> {@link CodecUtil#checkHeader CodecHeader}
- FieldsCount --> {@link DataOutput#writeVInt VInt}
- FieldName --> {@link DataOutput#writeString String}
- FieldBits, DocValuesBits --> {@link DataOutput#writeByte Byte}
- FieldNumber --> {@link DataOutput#writeInt VInt}
- Attributes --> {@link DataOutput#writeStringStringMap Map<String,String>}
Field Descriptions:
- FieldsCount: the number of fields in this file.
- FieldName: name of the field as a UTF-8 String.
- FieldNumber: the field's number. Note that unlike previous versions of Lucene, the fields are not numbered implicitly by their order in the file, instead explicitly.
- FieldBits: a byte containing field options.
  - The low-order bit is one for indexed fields, and zero for non-indexed fields.
  - The second lowest-order bit is one for fields that have term vectors stored, and zero for fields without term vectors.
  - If the third lowest order-bit is set (0x4), offsets are stored into the postings list in addition to positions.
  - Fourth bit is unused.
  - If the fifth lowest-order bit is set (0x10), norms are omitted for the indexed field.
  - If the sixth lowest-order bit is set (0x20), payloads are stored for the indexed field.
  - If the seventh lowest-order bit is set (0x40), term frequencies and positions omitted for the indexed field.
  - If the eighth lowest-order bit is set (0x80), positions are omitted for the indexed field.
- DocValuesBits: a byte containing per-document value types. The type recorded as two four-bit integers, with the high-order bits representing norms options, and the low-order bits representing {@code DocValues} options. Each four-bit integer can be decoded as such:
  - 0: no DocValues for this field.
  - 1: NumericDocValues. ( {@link DocValuesType#NUMERIC})
  - 2: BinaryDocValues. ( {@code DocValuesType#BINARY})
  - 3: SortedDocValues. ( {@code DocValuesType#SORTED})
- Attributes: a key-value map of codec-private attributes.
@lucene.experimental

        dvFormat = DocValuesFormat.forName(formats[random.nextInt(formats.length)]);
      } else {
        dvFormat = DocValuesFormat.forName(TEST_DOCVALUESFORMAT);
      }
      
      codec = new Lucene42Codec() {       
        @Override
        public PostingsFormat getPostingsFormatForField(String field) {
          return format;
        }

View Full Code Here

    Directory directory = newDirectory();
    // we don't use RandomIndexWriter because it might add more docvalues than we expect !!!!1
    IndexWriterConfig iwc = newIndexWriterConfig(TEST_VERSION_CURRENT, analyzer);
    final DocValuesFormat fast = DocValuesFormat.forName("Lucene42");
    final DocValuesFormat slow = DocValuesFormat.forName("SimpleText");
    iwc.setCodec(new Lucene42Codec() {
      @Override
      public DocValuesFormat getDocValuesFormatForField(String field) {
        if ("dv1".equals(field)) {
          return fast;
        } else {

View Full Code Here

        dvFormat = DocValuesFormat.forName(formats[random.nextInt(formats.length)]);
      } else {
        dvFormat = DocValuesFormat.forName(TEST_DOCVALUESFORMAT);
      }
      
      codec = new Lucene42Codec() {       
        @Override
        public PostingsFormat getPostingsFormatForField(String field) {
          return format;
        }

View Full Code Here

    // (and maybe their params, too) to infostream on flush and merge.
    // otherwise in a real debugging situation we won't know whats going on!
    if (LuceneTestCase.VERBOSE) {
      System.out.println("forcing postings format to:" + format);
    }
    return new Lucene42Codec() {
      @Override
      public PostingsFormat getPostingsFormatForField(String field) {
        return format;
      }
    };

View Full Code Here

    // (and maybe their params, too) to infostream on flush and merge.
    // otherwise in a real debugging situation we won't know whats going on!
    if (LuceneTestCase.VERBOSE) {
      System.out.println("forcing docvalues format to:" + format);
    }
    return new Lucene42Codec() {
      @Override
      public DocValuesFormat getDocValuesFormatForField(String field) {
        return format;
      }
    };

View Full Code Here

  
  public void testWriteReadMerge() throws IOException {
    // get another codec, other than the default: so we are merging segments across different codecs
    final Codec otherCodec;
    if ("SimpleText".equals(Codec.getDefault().getName())) {
      otherCodec = new Lucene42Codec();
    } else {
      otherCodec = new SimpleTextCodec();
    }
    Directory dir = newDirectory();
    IndexWriterConfig iwConf = newIndexWriterConfig(TEST_VERSION_CURRENT, new MockAnalyzer(random()));

View Full Code Here


  /** Override this to customize index settings, e.g. which
   *  codec to use. */
  protected IndexWriterConfig getIndexWriterConfig(Version matchVersion, Analyzer indexAnalyzer) {
    IndexWriterConfig iwc = new IndexWriterConfig(matchVersion, indexAnalyzer);
    iwc.setCodec(new Lucene42Codec());
    iwc.setOpenMode(IndexWriterConfig.OpenMode.CREATE);
    return iwc;
  }

View Full Code Here

    }
    dir.close();
  }
  
  public void testSameCodecDifferentInstance() throws Exception {
    Codec codec = new Lucene42Codec() {
      @Override
      public PostingsFormat getPostingsFormatForField(String field) {
        if ("id".equals(field)) {
          return new Pulsing41PostingsFormat(1);
        } else if ("date".equals(field)) {

View Full Code Here

    };
    doTestMixedPostings(codec);
  }
  
  public void testSameCodecDifferentParams() throws Exception {
    Codec codec = new Lucene42Codec() {
      @Override
      public PostingsFormat getPostingsFormatForField(String field) {
        if ("id".equals(field)) {
          return new Pulsing41PostingsFormat(1);
        } else if ("date".equals(field)) {

View Full Code Here

    dir.close();
  }
  
  private static final class UnRegisteredCodec extends FilterCodec {
    public UnRegisteredCodec() {
      super("NotRegistered", new Lucene42Codec());
    }

View Full Code Here

0 1 2 3

TOP

Related Classes of org.apache.lucene.codecs.lucene42.Lucene42FieldInfosFormat

org.apache.lucene.codecs.asserting.AssertingCodec

org.apache.lucene.codecs.cheapbastard.CheapBastardCodec

org.apache.lucene.codecs.compressing.CompressingCodec

org.apache.lucene.codecs.compressing.FastCompressingCodec

org.apache.lucene.codecs.compressing.FastDecompressionCompressingCodec

org.apache.lucene.codecs.compressing.HighCompressionCompressingCodec

org.apache.lucene.codecs.perfield.TestPerFieldDocValuesFormat

org.apache.lucene.codecs.perfield.TestPerFieldPostingsFormat2

org.apache.lucene.index.BaseStoredFieldsFormatTestCase

org.apache.lucene.index.BinaryDocValues

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.