Type Members

1.  trait CloseableIterator[T] extends Iterator[T] with Closeable

   :: DeveloperApi ::

   :: DeveloperApi ::

   An iterator that may contain resources which should be released after use. Users of CloseableIterator are responsible for closing the iterator if they are done with it.

   Since

   1.0.0

2.  abstract class LogStore extends AnyRef

   :: DeveloperApi ::

   :: DeveloperApi ::

   General interface for all critical file system operations required to read and write the Delta logs. The correctness is predicated on the atomicity and durability guarantees of the implementation of this interface. Specifically,

   • Atomic visibility of files: If isPartialWriteVisible is false, any file written through this store must be made visible atomically. In other words, this should not generate partial files.
   • Mutual exclusion: Only one writer must be able to create (or rename) a file at the final destination.
   • Consistent listing: Once a file has been written in a directory, all future listings for that directory must return that file.

   All subclasses of this interface is required to have a constructor that takes Configuration as a single parameter. This constructor is used to dynamically create the LogStore.

   LogStore and its implementations are not meant for direct access but for configuration based on storage system. See https://docs.delta.io/latest/delta-storage.html for details.

   Since

   1.0.0