A B C D E F G H I L M N O P R T U V W
All Classes All Packages

A

addColumn(String, String) - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

addColumn(String, String, boolean) - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

addColumn(String, DataType) - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

addColumn(String, DataType, boolean) - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

addColumn(StructField) - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

addColumns(StructType) - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

alias(String) - Method in class io.delta.tables.DeltaTable

Apply an alias to the DeltaTable.

as(String) - Method in class io.delta.tables.DeltaTable

Apply an alias to the DeltaTable.

B

build() - Method in class io.delta.tables.DeltaColumnBuilder

:: Evolving ::

C

CloseableIterator<T> - Interface in io.delta.storage

:: DeveloperApi :: An iterator that may contain resources which should be released after use.

columnBuilder(String) - Static method in class io.delta.tables.DeltaTable

:: Evolving ::

columnBuilder(SparkSession, String) - Static method in class io.delta.tables.DeltaTable

:: Evolving ::

comment(String) - Method in class io.delta.tables.DeltaColumnBuilder

:: Evolving ::

comment(String) - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

ConcurrentAppendException - Exception in io.delta.exceptions

:: Evolving ::

ConcurrentAppendException(String) - Constructor for exception io.delta.exceptions.ConcurrentAppendException

ConcurrentDeleteDeleteException - Exception in io.delta.exceptions

:: Evolving ::

ConcurrentDeleteDeleteException(String) - Constructor for exception io.delta.exceptions.ConcurrentDeleteDeleteException

ConcurrentDeleteReadException - Exception in io.delta.exceptions

:: Evolving ::

ConcurrentDeleteReadException(String) - Constructor for exception io.delta.exceptions.ConcurrentDeleteReadException

ConcurrentTransactionException - Exception in io.delta.exceptions

:: Evolving ::

ConcurrentTransactionException(String) - Constructor for exception io.delta.exceptions.ConcurrentTransactionException

ConcurrentWriteException - Exception in io.delta.exceptions

:: Evolving ::

ConcurrentWriteException(String) - Constructor for exception io.delta.exceptions.ConcurrentWriteException

convertToDelta(SparkSession, String) - Static method in class io.delta.tables.DeltaTable

Create a DeltaTable from the given parquet table.

convertToDelta(SparkSession, String, String) - Static method in class io.delta.tables.DeltaTable

Create a DeltaTable from the given parquet table and partition schema.

convertToDelta(SparkSession, String, StructType) - Static method in class io.delta.tables.DeltaTable

Create a DeltaTable from the given parquet table and partition schema.

create() - Static method in class io.delta.tables.DeltaTable

:: Evolving ::

create(SparkSession) - Static method in class io.delta.tables.DeltaTable

:: Evolving ::

createIfNotExists() - Static method in class io.delta.tables.DeltaTable

:: Evolving ::

createIfNotExists(SparkSession) - Static method in class io.delta.tables.DeltaTable

:: Evolving ::

createOrReplace() - Static method in class io.delta.tables.DeltaTable

:: Evolving ::

createOrReplace(SparkSession) - Static method in class io.delta.tables.DeltaTable

:: Evolving ::

D

dataType(String) - Method in class io.delta.tables.DeltaColumnBuilder

:: Evolving ::

dataType(DataType) - Method in class io.delta.tables.DeltaColumnBuilder

:: Evolving ::

delete() - Method in class io.delta.tables.DeltaMergeMatchedActionBuilder

Delete a matched row from the table.

delete() - Method in class io.delta.tables.DeltaTable

Delete data from the table.

delete(String) - Method in class io.delta.tables.DeltaTable

Delete data from the table that match the given condition.

delete(Column) - Method in class io.delta.tables.DeltaTable

Delete data from the table that match the given condition.

DeltaColumnBuilder - Class in io.delta.tables

:: Evolving ::

DeltaConcurrentModificationException - Exception in io.delta.exceptions

:: Evolving ::

DeltaConcurrentModificationException(String) - Constructor for exception io.delta.exceptions.DeltaConcurrentModificationException

DeltaMergeBuilder - Class in io.delta.tables

Builder to specify how to merge data from source DataFrame into the target Delta table.

DeltaMergeBuilder() - Constructor for class io.delta.tables.DeltaMergeBuilder

DeltaMergeMatchedActionBuilder - Class in io.delta.tables

Builder class to specify the actions to perform when a target table row has matched a source row based on the given merge condition and optional match condition.

DeltaMergeMatchedActionBuilder() - Constructor for class io.delta.tables.DeltaMergeMatchedActionBuilder

DeltaMergeNotMatchedActionBuilder - Class in io.delta.tables

Builder class to specify the actions to perform when a source row has not matched any target Delta table row based on the merge condition, but has matched the additional condition if specified.

DeltaMergeNotMatchedActionBuilder() - Constructor for class io.delta.tables.DeltaMergeNotMatchedActionBuilder

DeltaOptimizeBuilder - Class in io.delta.tables

Builder class for constructing OPTIMIZE command and executing.

DeltaOptimizeBuilder() - Constructor for class io.delta.tables.DeltaOptimizeBuilder

DeltaTable - Class in io.delta.tables

Main class for programmatically interacting with Delta tables.

DeltaTableBuilder - Class in io.delta.tables

:: Evolving ::

detail() - Method in class io.delta.tables.DeltaTable

:: Evolving ::

E

execute() - Method in class io.delta.tables.DeltaMergeBuilder

Execute the merge operation based on the built matched and not matched actions.

execute() - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

executeCompaction() - Method in class io.delta.tables.DeltaOptimizeBuilder

Compact the small files in selected partitions.

executeZOrderBy(Seq<String>) - Method in class io.delta.tables.DeltaOptimizeBuilder

Z-Order the data in selected partitions using the given columns.

F

forName(String) - Static method in class io.delta.tables.DeltaTable

Instantiate a DeltaTable object using the given table or view name.

forName(SparkSession, String) - Static method in class io.delta.tables.DeltaTable

Instantiate a DeltaTable object using the given table or view name using the given SparkSession.

forPath(String) - Static method in class io.delta.tables.DeltaTable

Instantiate a DeltaTable object representing the data at the given path, If the given path is invalid (i.e.

forPath(SparkSession, String) - Static method in class io.delta.tables.DeltaTable

Instantiate a DeltaTable object representing the data at the given path, If the given path is invalid (i.e.

G

generate(String) - Method in class io.delta.tables.DeltaTable

Generate a manifest for the given Delta Table

generatedAlwaysAs(String) - Method in class io.delta.tables.DeltaColumnBuilder

:: Evolving ::

H

history() - Method in class io.delta.tables.DeltaTable

Get the information available commits on this table as a Spark DataFrame.

history(int) - Method in class io.delta.tables.DeltaTable

Get the information of the latest limit commits on this table as a Spark DataFrame.

I

initHadoopConf() - Method in class io.delta.storage.LogStore

:: DeveloperApi :: Hadoop configuration that should only be used during initialization of LogStore.

insert(Map<String, Column>) - Method in class io.delta.tables.DeltaMergeNotMatchedActionBuilder

Insert a new row to the target table based on the rules defined by values.

insert(Map<String, Column>) - Method in class io.delta.tables.DeltaMergeNotMatchedActionBuilder

Insert a new row to the target table based on the rules defined by values.

insertAll() - Method in class io.delta.tables.DeltaMergeNotMatchedActionBuilder

Insert a new target Delta table row by assigning the target columns to the values of the corresponding columns in the source row.

insertExpr(Map<String, String>) - Method in class io.delta.tables.DeltaMergeNotMatchedActionBuilder

Insert a new row to the target table based on the rules defined by values.

insertExpr(Map<String, String>) - Method in class io.delta.tables.DeltaMergeNotMatchedActionBuilder

Insert a new row to the target table based on the rules defined by values.

io.delta.exceptions - package io.delta.exceptions

io.delta.storage - package io.delta.storage

io.delta.tables - package io.delta.tables

isDeltaTable(String) - Static method in class io.delta.tables.DeltaTable

Check if the provided identifier string, in this case a file path, is the root of a Delta table.

isDeltaTable(SparkSession, String) - Static method in class io.delta.tables.DeltaTable

Check if the provided identifier string, in this case a file path, is the root of a Delta table using the given SparkSession.

isPartialWriteVisible(Path, Configuration) - Method in class io.delta.storage.LogStore

:: DeveloperApi :: Whether a partial write is visible for the underlying file system of `path`.

L

listFrom(Path, Configuration) - Method in class io.delta.storage.LogStore

:: DeveloperApi :: List the paths in the same directory that are lexicographically greater or equal to (UTF-8 sorting) the given `path`.

location(String) - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

LogStore - Class in io.delta.storage

:: DeveloperApi ::

LogStore(Configuration) - Constructor for class io.delta.storage.LogStore

M

merge(Dataset<Row>, String) - Method in class io.delta.tables.DeltaTable

Merge data from the source DataFrame based on the given merge condition.

merge(Dataset<Row>, Column) - Method in class io.delta.tables.DeltaTable

Merge data from the source DataFrame based on the given merge condition.

MetadataChangedException - Exception in io.delta.exceptions

:: Evolving ::

MetadataChangedException(String) - Constructor for exception io.delta.exceptions.MetadataChangedException

N

nullable(boolean) - Method in class io.delta.tables.DeltaColumnBuilder

:: Evolving ::

O

optimize() - Method in class io.delta.tables.DeltaTable

Optimize the data layout of the table.

P

partitionedBy(String...) - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

partitionedBy(Seq<String>) - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

property(String, String) - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

ProtocolChangedException - Exception in io.delta.exceptions

:: Evolving ::

ProtocolChangedException(String) - Constructor for exception io.delta.exceptions.ProtocolChangedException

R

read(Path, Configuration) - Method in class io.delta.storage.LogStore

:: DeveloperApi :: Load the given file and return an `Iterator` of lines, with line breaks removed from each line.

replace() - Static method in class io.delta.tables.DeltaTable

:: Evolving ::

replace(SparkSession) - Static method in class io.delta.tables.DeltaTable

:: Evolving ::

resolvePathOnPhysicalStorage(Path, Configuration) - Method in class io.delta.storage.LogStore

:: DeveloperApi :: Resolve the fully qualified path for the given `path`.

restoreToTimestamp(String) - Method in class io.delta.tables.DeltaTable

Restore the DeltaTable to an older version of the table specified by a timestamp.

restoreToVersion(long) - Method in class io.delta.tables.DeltaTable

Restore the DeltaTable to an older version of the table specified by version number.

T

tableName(String) - Method in class io.delta.tables.DeltaTableBuilder

:: Evolving ::

toDF() - Method in class io.delta.tables.DeltaTable

Get a DataFrame (that is, Dataset[Row]) representation of this Delta table.

U

update(Map<String, Column>) - Method in class io.delta.tables.DeltaMergeMatchedActionBuilder

Update a matched table row based on the rules defined by set.

update(Map<String, Column>) - Method in class io.delta.tables.DeltaTable

Update rows in the table based on the rules defined by set.

update(Column, Map<String, Column>) - Method in class io.delta.tables.DeltaTable

Update data from the table on the rows that match the given condition based on the rules defined by set.

update(Column, Map<String, Column>) - Method in class io.delta.tables.DeltaTable

Update data from the table on the rows that match the given condition based on the rules defined by set.

update(Map<String, Column>) - Method in class io.delta.tables.DeltaTable

Update rows in the table based on the rules defined by set.

update(Map<String, Column>) - Method in class io.delta.tables.DeltaMergeMatchedActionBuilder

Update the matched table rows based on the rules defined by set.

updateAll() - Method in class io.delta.tables.DeltaMergeMatchedActionBuilder

Update all the columns of the matched table row with the values of the corresponding columns in the source row.

updateExpr(String, Map<String, String>) - Method in class io.delta.tables.DeltaTable

Update data from the table on the rows that match the given condition, which performs the rules defined by set.

updateExpr(String, Map<String, String>) - Method in class io.delta.tables.DeltaTable

Update data from the table on the rows that match the given condition, which performs the rules defined by set.

updateExpr(Map<String, String>) - Method in class io.delta.tables.DeltaMergeMatchedActionBuilder

Update a matched table row based on the rules defined by set.

updateExpr(Map<String, String>) - Method in class io.delta.tables.DeltaTable

Update rows in the table based on the rules defined by set.

updateExpr(Map<String, String>) - Method in class io.delta.tables.DeltaTable

Update rows in the table based on the rules defined by set.

updateExpr(Map<String, String>) - Method in class io.delta.tables.DeltaMergeMatchedActionBuilder

Update the matched table rows based on the rules defined by set.

upgradeTableProtocol(int, int) - Method in class io.delta.tables.DeltaTable

Updates the protocol version of the table to leverage new features.

V

vacuum() - Method in class io.delta.tables.DeltaTable

Recursively delete files and directories in the table that are not needed by the table for maintaining older versions up to the given retention threshold.

vacuum(double) - Method in class io.delta.tables.DeltaTable

Recursively delete files and directories in the table that are not needed by the table for maintaining older versions up to the given retention threshold.

W

whenMatched() - Method in class io.delta.tables.DeltaMergeBuilder

Build the actions to perform when the merge condition was matched.

whenMatched(String) - Method in class io.delta.tables.DeltaMergeBuilder

Build the actions to perform when the merge condition was matched and the given condition is true.

whenMatched(Column) - Method in class io.delta.tables.DeltaMergeBuilder

Build the actions to perform when the merge condition was matched and the given condition is true.

whenNotMatched() - Method in class io.delta.tables.DeltaMergeBuilder

Build the action to perform when the merge condition was not matched.

whenNotMatched(String) - Method in class io.delta.tables.DeltaMergeBuilder

Build the actions to perform when the merge condition was not matched and the given condition is true.

whenNotMatched(Column) - Method in class io.delta.tables.DeltaMergeBuilder

Build the actions to perform when the merge condition was not matched and the given condition is true.

where(String) - Method in class io.delta.tables.DeltaOptimizeBuilder

Apply partition filter on this optimize command builder to limit the operation on selected partitions.

write(Path, Iterator<String>, Boolean, Configuration) - Method in class io.delta.storage.LogStore

:: DeveloperApi :: Write the given `actions` to the given `path` with or without overwrite as indicated.

A B C D E F G H I L M N O P R T U V W
All Classes All Packages