Package org.elasticsearch.xpack.esql.datasource.ndjson

Class NdJsonFormatReader

java.lang.Object

org.elasticsearch.xpack.esql.datasource.ndjson.NdJsonFormatReader

All Implemented Interfaces:

Closeable, AutoCloseable, FormatReader, SegmentableFormatReader

public class NdJsonFormatReader
extends Object
implements SegmentableFormatReader

FormatReader implementation for NDJSON files. Implements SegmentableFormatReader for intra-file parallel parsing.

Nested Class Summary

Nested classes/interfaces inherited from interface org.elasticsearch.xpack.esql.datasources.spi.FormatReader

FormatReader.SchemaResolution

Field Summary

Fields

Modifier and Type	Field	Description
static final int	DEFAULT_SCHEMA_SAMPLE_SIZE
static final String	SCHEMA_SAMPLE_SIZE_SETTING

Fields inherited from interface org.elasticsearch.xpack.esql.datasources.spi.FormatReader

NO_LIMIT

Constructor Summary

Constructors

Constructor	Description
NdJsonFormatReader(Settings settings, BlockFactory blockFactory, List<Attribute> resolvedSchema)

Method Summary

Modifier and Type	Method	Description
void	close()
List<String>	fileExtensions()
long	findNextRecordBoundary(InputStream stream)
String	formatName()
SourceMetadata	metadata(StorageObject object)
CloseableIterator<Page>	read(StorageObject object, FormatReadContext context)
FormatReader	withConfig(Map<String,Object> config)
NdJsonFormatReader	withSchema(List<Attribute> schema)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.elasticsearch.xpack.esql.datasources.spi.FormatReader

aggregatePushdownSupport, defaultErrorPolicy, defaultSchemaResolution, filterPushdownSupport, read, readAsync, schema, supportsNativeAsync, withPushedFilter

Methods inherited from interface org.elasticsearch.xpack.esql.datasources.spi.SegmentableFormatReader

minimumSegmentSize

Field Details

SCHEMA_SAMPLE_SIZE_SETTING

public static final String SCHEMA_SAMPLE_SIZE_SETTING

See Also:

• Constant Field Values

DEFAULT_SCHEMA_SAMPLE_SIZE

public static final int DEFAULT_SCHEMA_SAMPLE_SIZE

See Also:

• Constant Field Values

Constructor Details

NdJsonFormatReader

public NdJsonFormatReader(Settings settings,
 BlockFactory blockFactory,
 List<Attribute> resolvedSchema)

Method Details

withSchema

public NdJsonFormatReader withSchema(List<Attribute> schema)

Specified by:

withSchema in interface FormatReader

withConfig

public FormatReader withConfig(Map<String,Object> config)

Specified by:

withConfig in interface FormatReader

metadata

public SourceMetadata metadata(StorageObject object)
                        throws IOException

Specified by:

metadata in interface FormatReader

Throws:

IOException

read

public CloseableIterator<Page> read(StorageObject object,
 FormatReadContext context)
                             throws IOException

Specified by:

read in interface FormatReader

Throws:

IOException

findNextRecordBoundary

public long findNextRecordBoundary(InputStream stream)
                            throws IOException

Specified by:

findNextRecordBoundary in interface SegmentableFormatReader

Throws:

IOException

formatName

public String formatName()

Specified by:

formatName in interface FormatReader

fileExtensions

public List<String> fileExtensions()

Specified by:

fileExtensions in interface FormatReader

close

public void close()

Specified by:

close in interface AutoCloseable

Specified by:

close in interface Closeable