Welcome to the Delta Lake Documentation

This is the documentation site for Delta Lake.

• Introduction to Delta Lake
• Delta Lake Quickstart
  • Set up Apache Spark with Delta Lake
  • Create a table
  • Read data
  • Update table data
  • Read older versions of data using time travel
  • Write a stream of data to a table
  • Read a stream of changes from a table
• Table Batch Reads and Writes
  • Create a table
  • Read a table
  • Write to a table
  • Schema validation
  • Replace table schema
  • Views on tables
• Table Streaming Reads and Writes
  • Delta table as a stream source
  • Delta table as a sink
• Table Deletes, Updates, and Merges
  • Delete from a table
  • Update a table
  • Upsert into a table using Merge
  • Merge examples
• Table Utility Commands
  • Vacuum
  • History
  • Generate
  • Convert to Delta
  • Convert Delta table to a Parquet table
  • Enable SQL commands within Apache Spark
• Delta Lake API Reference
• Storage Configuration
  • HDFS
  • Amazon S3
  • Microsoft Azure storage
• Concurrency Control
  • Optimistic concurrency control
  • Write conflicts
  • Avoid conflicts using partitioning and disjoint command conditions
  • Conflict exceptions
• Integrations
  • Presto and Athena to Delta Lake Integration
  • Redshift Spectrum to Delta Lake Integration
  • Snowflake to Delta Lake Integration
  • Apache Hive to Delta Lake Integration
• Migrate Workloads to Delta Lake
• Best Practices
  • Choose the right partition column
  • Compact files
• Frequently Asked Questions (FAQ)
  • What is Delta Lake?
  • How is Delta Lake related to Apache Spark?
  • What format does Delta Lake use to store data?
  • How can I read and write data with Delta Lake?
  • Where does Delta Lake store the data?
  • Can I stream data directly into and from Delta tables?
  • Does Delta Lake support writes or reads using the Spark Streaming DStream API?
  • When I use Delta Lake, will I be able to port my code to other Spark platforms easily?
  • Does Delta Lake support multi-table transactions?
• Additional Resources
  • Blog posts
  • Talks
  • Examples
  • Delta Lake transaction log specification