Index

A B C D E F G I L M O P R S T W
All Classes and Interfaces|All Packages

A

ArrowFormat - Class in org.apache.arrow.datafusion

The Apache Arrow IPC file format configuration.

ArrowFormat() - Constructor for class org.apache.arrow.datafusion.ArrowFormat

Create a new ArrowFormat with default options

B

batchSize() - Method in class org.apache.arrow.datafusion.ExecutionOptions

Get the batch size

build() - Method in class org.apache.arrow.datafusion.ListingOptions.Builder

Build a new ListingOptions instance from the configured builder

build(SessionContext) - Method in class org.apache.arrow.datafusion.ListingTableConfig.Builder

Create the listing table config.

builder(String) - Static method in class org.apache.arrow.datafusion.ListingTableConfig

Create a new ListingTableConfig.Builder for a ListingTableConfig

builder(URI) - Static method in class org.apache.arrow.datafusion.ListingTableConfig

Create a new ListingTableConfig.Builder for a ListingTableConfig from a URI

builder(Path) - Static method in class org.apache.arrow.datafusion.ListingTableConfig

Create a new ListingTableConfig.Builder for a ListingTableConfig from a file path

builder(Path[]) - Static method in class org.apache.arrow.datafusion.ListingTableConfig

Create a new ListingTableConfig.Builder for a ListingTableConfig from an array of paths

builder(FileFormat) - Static method in class org.apache.arrow.datafusion.ListingOptions

Create a builder for listing options

Builder(String) - Constructor for class org.apache.arrow.datafusion.ListingTableConfig.Builder

Create a new ListingTableConfig.Builder

Builder(String[]) - Constructor for class org.apache.arrow.datafusion.ListingTableConfig.Builder

Create a new ListingTableConfig.Builder

Builder(FileFormat) - Constructor for class org.apache.arrow.datafusion.ListingOptions.Builder

Create a new ListingOptions builder

C

close() - Method in class org.apache.arrow.datafusion.ListingTable

coalesceBatches() - Method in class org.apache.arrow.datafusion.ExecutionOptions

Get whether batch coalescing is enabled

collect(BufferAllocator) - Method in interface org.apache.arrow.datafusion.DataFrame

Collect dataframe into a list of record batches

collectStatistics() - Method in class org.apache.arrow.datafusion.ExecutionOptions

Get whether statistics collection is enabled

create() - Static method in class org.apache.arrow.datafusion.SessionContexts

Create a new default session context

CsvFormat - Class in org.apache.arrow.datafusion

The CSV file format configuration

CsvFormat() - Constructor for class org.apache.arrow.datafusion.CsvFormat

Create new CSV format with default options

D

DataFrame - Interface in org.apache.arrow.datafusion

A dataframe is a rectangle shaped data that holds columns and rows, and can be collected into batches and read via reader.

dialect() - Method in class org.apache.arrow.datafusion.SqlParserOptions

Get the SQL dialect used

E

enableIdentNormalization() - Method in class org.apache.arrow.datafusion.SqlParserOptions

Get whether to convert identifiers to lowercase when not quoted

enablePageIndex() - Method in class org.apache.arrow.datafusion.ParquetOptions

Get whether parquet data page level metadata (Page Index) statistics are used

executeStream(BufferAllocator) - Method in interface org.apache.arrow.datafusion.DataFrame

Execute this DataFrame and return a stream of the result data

executionOptions() - Method in class org.apache.arrow.datafusion.SessionConfig

Get options related to query execution

ExecutionOptions - Class in org.apache.arrow.datafusion

Configures options related to query execution

F

FileFormat - Interface in org.apache.arrow.datafusion

Interface for file formats that can provide table data

G

getPointer() - Method in class org.apache.arrow.datafusion.ListingTable

getPointer() - Method in class org.apache.arrow.datafusion.ListingTable

Get a pointer to the native object

getRuntime() - Method in interface org.apache.arrow.datafusion.SessionContext

Get the runtime associated with this context

getVectorSchemaRoot() - Method in interface org.apache.arrow.datafusion.RecordBatchStream

Get the VectorSchemaRoot that will be populated with data as the stream is iterated over

I

intoView() - Method in interface org.apache.arrow.datafusion.DataFrame

Converts this DataFrame into a TableProvider that can be registered as a table view using SessionContext.registerParquet(String, Path)

isClosed() - Method in class org.apache.arrow.datafusion.ListingTable

L

ListingOptions - Class in org.apache.arrow.datafusion

Configures options for a ListingTable

ListingOptions.Builder - Class in org.apache.arrow.datafusion

A Builder for ListingOptions instances

ListingTable - Class in org.apache.arrow.datafusion

A data source composed of multiple files that share a schema

ListingTable(ListingTableConfig) - Constructor for class org.apache.arrow.datafusion.ListingTable

Create a new listing table

ListingTableConfig - Class in org.apache.arrow.datafusion

Configuration for creating a ListingTable

ListingTableConfig.Builder - Class in org.apache.arrow.datafusion

A Builder for ListingTableConfig instances

loadNextBatch() - Method in interface org.apache.arrow.datafusion.RecordBatchStream

Load the next record batch in the stream into the VectorSchemaRoot

M

metadataSizeHint() - Method in class org.apache.arrow.datafusion.ParquetOptions

Get the metadata size hint

O

org.apache.arrow.datafusion - package org.apache.arrow.datafusion

This module contains a Java JNI binding to Apache Arrow DataFusion which is the query engine library to work with data in Arrow format.

P

parquet() - Method in class org.apache.arrow.datafusion.ExecutionOptions

Get execution options related to reading Parquet data

ParquetFormat - Class in org.apache.arrow.datafusion

The Apache Parquet file format configuration

ParquetFormat() - Constructor for class org.apache.arrow.datafusion.ParquetFormat

Create new ParquetFormat with default options

ParquetOptions - Class in org.apache.arrow.datafusion

Configures options specific to reading Parquet data

parseFloatAsDecimal() - Method in class org.apache.arrow.datafusion.SqlParserOptions

Get whether to parse floats as decimal type

pruning() - Method in class org.apache.arrow.datafusion.ParquetOptions

Get whether pruning is enabled, meaning reading row groups will be skipped based on metadata

pushdownFilters() - Method in class org.apache.arrow.datafusion.ParquetOptions

Get whether filter pushdown is enabled, so filters are applied during parquet decoding

R

RecordBatchStream - Interface in org.apache.arrow.datafusion

A record batch stream is a stream of tabular Arrow data that can be iterated over asynchronously

registerChild(AbstractProxy) - Method in class org.apache.arrow.datafusion.ListingTable

Register a child proxy object that should be closed when this object is closed

registerCsv(String, Path) - Method in interface org.apache.arrow.datafusion.SessionContext

Registering a csv file with the context

registerParquet(String, Path) - Method in interface org.apache.arrow.datafusion.SessionContext

Registering a parquet file with the context

registerTable(String, TableProvider) - Method in interface org.apache.arrow.datafusion.SessionContext

Registers a TableProvider as a table that can be referenced from SQL statements executed against this context.

reorderFilters() - Method in class org.apache.arrow.datafusion.ParquetOptions

Get whether filter reordering is enabled to minimize evaluation cost

Runtime - Interface in org.apache.arrow.datafusion

A runtime represents the underlying async runtime in datafusion engine

S

SessionConfig - Class in org.apache.arrow.datafusion

Configuration for creating a SessionContext using SessionContexts.withConfig(org.apache.arrow.datafusion.SessionConfig)

SessionConfig() - Constructor for class org.apache.arrow.datafusion.SessionConfig

Create a new default SessionConfig

SessionContext - Interface in org.apache.arrow.datafusion

A session context holds resources and is the entrance for obtaining DataFrame

SessionContexts - Class in org.apache.arrow.datafusion

Manages session contexts

show() - Method in interface org.apache.arrow.datafusion.DataFrame

Print results.

skipMetadata() - Method in class org.apache.arrow.datafusion.ParquetOptions

Get whether file metadata is skipped, to avoid schema conflicts

sql(String) - Method in interface org.apache.arrow.datafusion.SessionContext

Obtain the DataFrame by running the sql against the datafusion library

sqlParserOptions() - Method in class org.apache.arrow.datafusion.SessionConfig

Get options specific to parsing SQL queries

SqlParserOptions - Class in org.apache.arrow.datafusion

Configures options specific to parsing SQL queries

T

TableProvider - Interface in org.apache.arrow.datafusion

vague interface that maps to Arc<dyn TableProvider>.

targetPartitions() - Method in class org.apache.arrow.datafusion.ExecutionOptions

Get the target number of partitions

W

withBatchSize(long) - Method in class org.apache.arrow.datafusion.ExecutionOptions

Set the size of batches to use when creating new data batches

withCoalesceBatches(boolean) - Method in class org.apache.arrow.datafusion.ExecutionOptions

Set whether to enable batch coalescing

withCollectStat(boolean) - Method in class org.apache.arrow.datafusion.ListingOptions.Builder

Specify whether to collect statistics from files

withCollectStatistics(boolean) - Method in class org.apache.arrow.datafusion.ExecutionOptions

Set whether to enable statistics collection

withConfig(Consumer<SessionConfig>) - Static method in class org.apache.arrow.datafusion.SessionContexts

Create a new session context using the provided callback to configure the session

withConfig(SessionConfig) - Static method in class org.apache.arrow.datafusion.SessionContexts

Create a new session context using the provided configuration

withConfiguration(Consumer<SessionConfig>) - Method in class org.apache.arrow.datafusion.SessionConfig

Modify this session configuration and then return it, to simplify use in a try-with-resources statement

withDialect(String) - Method in class org.apache.arrow.datafusion.SqlParserOptions

Set the SQL dialect to use

withEnableIdentNormalization(boolean) - Method in class org.apache.arrow.datafusion.SqlParserOptions

Set whether to convert identifiers to lowercase when not quoted

withEnablePageIndex(boolean) - Method in class org.apache.arrow.datafusion.ParquetOptions

Set whether to use parquet data page level metadata (Page Index) statistics to reduce the number of rows decoded.

withFileExtension(String) - Method in class org.apache.arrow.datafusion.ListingOptions.Builder

Specify a suffix used to filter files in the listing location

withListingOptions(ListingOptions) - Method in class org.apache.arrow.datafusion.ListingTableConfig.Builder

Specify the ListingOptions to use

withMetadataSizeHint(Optional<Long>) - Method in class org.apache.arrow.datafusion.ParquetOptions

Set the metadata size hint, which is used to attempt to read the full metadata at once rather than needing one read to get the metadata size and then a second read for the metadata itself.

withParseFloatAsDecimal(boolean) - Method in class org.apache.arrow.datafusion.SqlParserOptions

Set whether to parse floats as decimal type

withPruning(boolean) - Method in class org.apache.arrow.datafusion.ParquetOptions

Set whether pruning is enabled, meaning reading row groups will be skipped based on metadata

withPushdownFilters(boolean) - Method in class org.apache.arrow.datafusion.ParquetOptions

Set whether filter pushdown is enabled, so filters are applied during parquet decoding

withReorderFilters(boolean) - Method in class org.apache.arrow.datafusion.ParquetOptions

Set whether filter reordering is enabled to minimize evaluation cost

withSkipMetadata(boolean) - Method in class org.apache.arrow.datafusion.ParquetOptions

Set whether file metadata is skipped, to avoid schema conflicts

withTargetPartitions(long) - Method in class org.apache.arrow.datafusion.ExecutionOptions

Set the target number of partitions

writeCsv(Path) - Method in interface org.apache.arrow.datafusion.DataFrame

Write results to a csv file.

writeParquet(Path) - Method in interface org.apache.arrow.datafusion.DataFrame

Write results to a parquet file.

A B C D E F G I L M O P R S T W
All Classes and Interfaces|All Packages