Module org.elasticsearch.server

Package org.elasticsearch.index.codec.vectors.diskbbq.next

Class ESNextDiskBBQVectorsReader

java.lang.Object

org.apache.lucene.codecs.KnnVectorsReader

org.elasticsearch.index.codec.vectors.diskbbq.IVFVectorsReader<org.elasticsearch.index.codec.vectors.diskbbq.next.ESNextDiskBBQVectorsReader.NextFieldEntry>

org.elasticsearch.index.codec.vectors.diskbbq.next.ESNextDiskBBQVectorsReader

All Implemented Interfaces:

Closeable, AutoCloseable, VectorPreconditioner

public class ESNextDiskBBQVectorsReader
extends IVFVectorsReader<org.elasticsearch.index.codec.vectors.diskbbq.next.ESNextDiskBBQVectorsReader.NextFieldEntry>
implements VectorPreconditioner

Default implementation of IVFVectorsReader. It scores the posting lists centroids using brute force and then scores the top ones using the posting list.

Nested Class Summary

Nested classes/interfaces inherited from class org.elasticsearch.index.codec.vectors.diskbbq.IVFVectorsReader

IVFVectorsReader.FieldEntry, IVFVectorsReader.PostingVisitor

Field Summary

Fields inherited from class org.elasticsearch.index.codec.vectors.diskbbq.IVFVectorsReader

fields, ivfCentroids, ivfClusters, versionMeta

Constructor Summary

Constructors

Constructor	Description
ESNextDiskBBQVectorsReader(org.apache.lucene.index.SegmentReadState state, GenericFlatVectorReaders.LoadFlatVectorsReader getFormatReader)

Method Summary

Modifier and Type	Method	Description
protected org.elasticsearch.index.codec.vectors.diskbbq.next.ESNextDiskBBQVectorsReader.NextFieldEntry	doReadField(org.apache.lucene.store.IndexInput input, String rawVectorFormat, boolean useDirectIOReads, org.apache.lucene.index.VectorSimilarityFunction similarityFunction, org.apache.lucene.index.VectorEncoding vectorEncoding, int numCentroids, long centroidOffset, long centroidLength, long postingListOffset, long postingListLength, float[] globalCentroid, float globalCentroidDp)
CentroidIterator	getCentroidIterator(org.apache.lucene.index.FieldInfo fieldInfo, int numCentroids, org.apache.lucene.store.IndexInput centroids, float[] targetQuery, org.apache.lucene.store.IndexInput postingListSlice, org.apache.lucene.search.AcceptDocs acceptDocs, float approximateCost, org.apache.lucene.index.FloatVectorValues values, float visitRatio)
Map<String,Long>	getOffHeapByteSize(org.apache.lucene.index.FieldInfo fieldInfo)
IVFVectorsReader.PostingVisitor	getPostingVisitor(org.apache.lucene.index.FieldInfo fieldInfo, int numVectors, org.apache.lucene.store.IndexInput indexInput, float[] target, org.apache.lucene.util.Bits acceptDocs, org.apache.lucene.store.IndexInput centroidSlice)
Preconditioner	getPreconditioner(org.apache.lucene.index.FieldInfo fieldInfo)

Methods inherited from class org.elasticsearch.index.codec.vectors.diskbbq.IVFVectorsReader

checkIntegrity, close, getByteVectorValues, getFloatVectorValues, getReaderForField, openDataInput, search, search

Methods inherited from class org.apache.lucene.codecs.KnnVectorsReader

finishMerge, getMergeInstance, mergeOffHeapByteSizeMaps

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ESNextDiskBBQVectorsReader

public ESNextDiskBBQVectorsReader(org.apache.lucene.index.SegmentReadState state,
 GenericFlatVectorReaders.LoadFlatVectorsReader getFormatReader)
                           throws IOException

Throws:

IOException

Method Details

getCentroidIterator

public CentroidIterator getCentroidIterator(org.apache.lucene.index.FieldInfo fieldInfo,
 int numCentroids,
 org.apache.lucene.store.IndexInput centroids,
 float[] targetQuery,
 org.apache.lucene.store.IndexInput postingListSlice,
 org.apache.lucene.search.AcceptDocs acceptDocs,
 float approximateCost,
 org.apache.lucene.index.FloatVectorValues values,
 float visitRatio)
                                     throws IOException

Specified by:

getCentroidIterator in class IVFVectorsReader<org.elasticsearch.index.codec.vectors.diskbbq.next.ESNextDiskBBQVectorsReader.NextFieldEntry>

Throws:

IOException

doReadField

protected org.elasticsearch.index.codec.vectors.diskbbq.next.ESNextDiskBBQVectorsReader.NextFieldEntry doReadField(org.apache.lucene.store.IndexInput input,
 String rawVectorFormat,
 boolean useDirectIOReads,
 org.apache.lucene.index.VectorSimilarityFunction similarityFunction,
 org.apache.lucene.index.VectorEncoding vectorEncoding,
 int numCentroids,
 long centroidOffset,
 long centroidLength,
 long postingListOffset,
 long postingListLength,
 float[] globalCentroid,
 float globalCentroidDp)
                                                                                                            throws IOException

Specified by:

doReadField in class IVFVectorsReader<org.elasticsearch.index.codec.vectors.diskbbq.next.ESNextDiskBBQVectorsReader.NextFieldEntry>

Throws:

IOException

getPreconditioner

public Preconditioner getPreconditioner(org.apache.lucene.index.FieldInfo fieldInfo)
                                 throws IOException

Specified by:

getPreconditioner in interface VectorPreconditioner

Throws:

IOException

getPostingVisitor

public IVFVectorsReader.PostingVisitor getPostingVisitor(org.apache.lucene.index.FieldInfo fieldInfo,
 int numVectors,
 org.apache.lucene.store.IndexInput indexInput,
 float[] target,
 org.apache.lucene.util.Bits acceptDocs,
 org.apache.lucene.store.IndexInput centroidSlice)
                                                  throws IOException

Specified by:

getPostingVisitor in class IVFVectorsReader<org.elasticsearch.index.codec.vectors.diskbbq.next.ESNextDiskBBQVectorsReader.NextFieldEntry>

Throws:

IOException

getOffHeapByteSize

public Map<String,Long> getOffHeapByteSize(org.apache.lucene.index.FieldInfo fieldInfo)

Overrides:

getOffHeapByteSize in class IVFVectorsReader<org.elasticsearch.index.codec.vectors.diskbbq.next.ESNextDiskBBQVectorsReader.NextFieldEntry>