Package org.apache.arrow.datafusion

Class ParquetOptions

java.lang.Object
org.apache.arrow.datafusion.ParquetOptions
public class ParquetOptions extends Object
Configures options specific to reading Parquet data

  • Method Details

    • enablePageIndex

      public boolean enablePageIndex()
      Get whether parquet data page level metadata (Page Index) statistics are used
      Returns:
      whether using the page index is enabled

    • withEnablePageIndex

      public ParquetOptions withEnablePageIndex(boolean enabled)
      Set whether to use parquet data page level metadata (Page Index) statistics to reduce the number of rows decoded.
      Parameters:
      enabled - whether using the page index is enabled
      Returns:
      the modified ParquetOptions instance

    • pruning

      public boolean pruning()
      Get whether pruning is enabled, meaning reading row groups will be skipped based on metadata
      Returns:
      whether pruning is enabled

    • withPruning

      public ParquetOptions withPruning(boolean enabled)
      Set whether pruning is enabled, meaning reading row groups will be skipped based on metadata
      Parameters:
      enabled - whether to enable pruning
      Returns:
      the modified ParquetOptions instance

    • skipMetadata

      public boolean skipMetadata()
      Get whether file metadata is skipped, to avoid schema conflicts
      Returns:
      whether metadata is skipped

    • withSkipMetadata

      public ParquetOptions withSkipMetadata(boolean enabled)
      Set whether file metadata is skipped, to avoid schema conflicts
      Parameters:
      enabled - whether to skip metadata
      Returns:
      the modified ParquetOptions instance

    • metadataSizeHint

      public Optional<Long> metadataSizeHint()
      Get the metadata size hint
      Returns:
      metadata size hint value

    • withMetadataSizeHint

      public ParquetOptions withMetadataSizeHint(Optional<Long> metadataSizeHint)
      Set the metadata size hint, which is used to attempt to read the full metadata at once rather than needing one read to get the metadata size and then a second read for the metadata itself.
      Parameters:
      metadataSizeHint - the metadata size hint
      Returns:
      the modified ParquetOptions instance

    • pushdownFilters

      public boolean pushdownFilters()
      Get whether filter pushdown is enabled, so filters are applied during parquet decoding
      Returns:
      whether filter pushdown is enabled

    • withPushdownFilters

      public ParquetOptions withPushdownFilters(boolean enabled)
      Set whether filter pushdown is enabled, so filters are applied during parquet decoding
      Parameters:
      enabled - whether to pushdown filters
      Returns:
      the modified ParquetOptions instance

    • reorderFilters

      public boolean reorderFilters()
      Get whether filter reordering is enabled to minimize evaluation cost
      Returns:
      whether filter reordering is enabled

    • withReorderFilters

      public ParquetOptions withReorderFilters(boolean enabled)
      Set whether filter reordering is enabled to minimize evaluation cost
      Parameters:
      enabled - whether to reorder filters
      Returns:
      the modified ParquetOptions instance