Class IcebergDataSourcePlugin
java.lang.Object
org.elasticsearch.plugins.Plugin
org.elasticsearch.xpack.esql.datasource.iceberg.IcebergDataSourcePlugin
- All Implemented Interfaces:
Closeable,AutoCloseable,DataSourcePlugin
Data source plugin that provides Iceberg table catalog support for ESQL external data sources.
This plugin provides:
- Iceberg table catalog for reading Iceberg tables from S3
- Schema discovery from Iceberg metadata
- Predicate pushdown for efficient filtering
- Vectorized reading using Arrow format
The Iceberg implementation uses:
- Iceberg's StaticTableOperations for metadata access
- S3FileIO for S3 storage access
- ArrowReader for efficient vectorized columnar data reading
Heavy dependencies (Iceberg, Arrow, Parquet, AWS SDK) are isolated in this module to avoid jar hell issues in the core ESQL plugin.
-
Nested Class Summary
Nested classes/interfaces inherited from class org.elasticsearch.plugins.Plugin
Plugin.PluginServices -
Constructor Summary
Constructors -
Method Summary
Methods inherited from class org.elasticsearch.plugins.Plugin
additionalSettings, close, createComponents, getAdditionalIndexSettingProviders, getBootstrapChecks, getExecutorBuilders, getIndexTemplateMetadataUpgrader, getNamedWriteables, getNamedXContent, getProjectCustomMetadataUpgraders, getSettings, getSettingsFilter, onIndexModuleMethods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitMethods inherited from interface org.elasticsearch.xpack.esql.datasources.spi.DataSourcePlugin
connectors, decompressionCodecs, filterPushdownSupport, formatReaders, formatSpecs, namedWriteables, operatorFactories, sourceFactories, storageProviders, storageProviders, supportedConnectorSchemes, supportedSchemes
-
Constructor Details
-
IcebergDataSourcePlugin
public IcebergDataSourcePlugin()
-
-
Method Details
-
supportedCatalogs
- Specified by:
supportedCatalogsin interfaceDataSourcePlugin
-
tableCatalogs
- Specified by:
tableCatalogsin interfaceDataSourcePlugin
-