Package org.apache.arrow.datafusion

Interface DataFrame

public interface DataFrame
A dataframe is a rectangle shaped data that holds columns and rows, and can be collected into batches and read via reader.

  • Method Details

    • collect

      CompletableFuture<org.apache.arrow.vector.ipc.ArrowReader> collect(org.apache.arrow.memory.BufferAllocator allocator)
      Collect dataframe into a list of record batches
      Parameters:
      allocator - buffer allocator to allocate vectors within Reader
      Returns:
      reader instance to extract the data, you are expected to ArrowReader.close() it after usage to release memory

    • show

      CompletableFuture<Void> show()
      Print results.
      Returns:
      null

    • writeParquet

      CompletableFuture<Void> writeParquet(Path path)
      Write results to a parquet file.
      Parameters:
      path - path to write parquet file to
      Returns:
      null

    • writeCsv

      CompletableFuture<Void> writeCsv(Path path)
      Write results to a csv file.
      Parameters:
      path - path to write csv file to
      Returns:
      null

    • registerTable

      CompletableFuture<Void> registerTable(SessionContext context, String name)
      Register this dataframe as a temporary table.
      Parameters:
      context - SessionContext to register table to
      name - name of the tmp table
      Returns:
      null

    • getPointer

      long getPointer()