Package org.elasticsearch.xpack.esql.datasources
package org.elasticsearch.xpack.esql.datasources
-
ClassDescriptionSingle-split source operator factory that executes a connector query on a background thread and feeds pages into an
AsyncExternalSourceBufferfor the driver to consume.Thread-safe buffer for async external source data.Source operator that retrieves data from external sources (Iceberg tables, Parquet files, etc.).Dual-mode async factory for creating source operators that read from external storage.Auto-detecting partition detector that tries Hive-style detection first, then falls back to template-based detection if a path template is configured.A composite split that groups multiple child splits into a single scheduling unit.Aggregated capability declarations from all registeredDataSourcePlugininstances.Module that collects all data source implementations from plugins.Registry forDecompressionCodecimplementations, keyed by extension.Thread-safe queue ofExternalSplitinstances for parallel external source execution.Utility for draining pages from aCloseableIteratorinto anAsyncExternalSourceBufferwith backpressure.Extended interface for external data source metadata.Factory for creating source operators that read from external storage using the StorageProvider and FormatReader abstractions.Holds the result of external source resolution (Iceberg/Parquet metadata).Resolver for external data sources (Iceberg tables, Parquet files, etc.).Cluster settings for controlling ESQL external source cloud API rate limiting.Represents a byte range within a file for a file-based external source.DefaultSplitProviderfor file-based sources.Format-agnostic utility for adapting pushed filter expressions to a specific file's column set.Registry for filter pushdown support implementations.Registry for FormatReader implementations, keyed by format name and file extension.Detects Hive-style partition columns from file paths (e.g.,/year=2024/month=06/file.parquet).Registry for source operator factories.Coordinates parallel parsing of a single file by splitting it into byte-range segments and dispatching each segment to a parser thread.Configuration for partition detection strategy, parsed from WITH clause parameters.Pluggable strategy for detecting partition columns from file paths.Walks an unresolved logical plan extracting simple filter predicates fromFilternodes aboveUnresolvedExternalRelationnodes.Holds partition information detected from file paths.Schema reconciliation algorithms for multi-file external sources.Maps unified schema column positions to file-local column positions.Supported widening cast targets.Per-file schema information collected during reconciliation.Result of schema reconciliation during planning.Serializes and deserializesSourceStatisticsto/from a flatMap<String, Object>using well-known keys.Groups many smallExternalSplits intoCoalescedSplits to reduce scheduling overhead.Walks the physical plan tree, discovers splits for eachExternalSourceExec, and replaces them with split-enriched copies viaExternalSourceExec.withSplits(java.util.List<org.elasticsearch.xpack.esql.datasources.spi.ExternalSplit>).Metadata about an object returned from directory listing.Iterator over objects in a directory.Format-agnostic manager for creating StorageObject instances from paths.Registry for StorageProvider implementations, keyed by URI scheme.Detects partition columns from bare directory segments using a path template.