Welcome to the Delta Lake documentation

This is the documentation site for Delta Lake.

• Introduction to Delta Lake
• Delta Lake quickstart
  • Set up Apache Spark with Delta Lake
  • Create a table
  • Read data
  • Update table data
  • Read older versions of data using time travel
  • Write a stream of data to a table
  • Read a stream of changes from a table
• Table batch reads and writes
  • Create a table
  • Read a table
  • Write to a table
  • Schema validation
  • Replace table schema
  • Views on tables
• Table streaming reads and writes
  • Delta table as a stream source
  • Delta table as a sink
• Table deletes, updates, and merges
  • Delete from a table
  • Update a table
  • Upsert into a table using merge
  • Merge examples
• Table utility commands
  • Vacuum
  • History
  • Operation metrics keys
  • Generate
  • Convert to Delta
  • Convert Delta table to a Parquet table
  • Enable SQL commands within Apache Spark
• Delta Lake API reference
• Storage Configuration
  • HDFS
  • Amazon S3
  • Microsoft Azure storage
• Concurrency control
  • Optimistic concurrency control
  • Write conflicts
  • Avoid conflicts using partitioning and disjoint command conditions
  • Conflict exceptions
• Integrations
  • Presto and Athena to Delta Lake integration
  • Redshift Spectrum to Delta Lake integration
  • Snowflake to Delta Lake integration
  • Apache Hive to Delta Lake integration
• Migrate workloads to Delta Lake
• Best practices
  • Choose the right partition column
  • Compact files
• Frequently asked questions (FAQ)
  • What is Delta Lake?
  • How is Delta Lake related to Apache Spark?
  • What format does Delta Lake use to store data?
  • How can I read and write data with Delta Lake?
  • Where does Delta Lake store the data?
  • Can I stream data directly into and from Delta tables?
  • Does Delta Lake support writes or reads using the Spark Streaming DStream API?
  • When I use Delta Lake, will I be able to port my code to other Spark platforms easily?
  • Does Delta Lake support multi-table transactions?
• Additional resources
  • Blog posts
  • Talks
  • Examples
  • Delta Lake transaction log specification