Databricks Runtime 9.1 LTS is a long-term support (LTS) release of Databricks that was released in September 2021 and is powered by Apache Spark 3.1.2. LTS releases receive critical bug fixes and security updates for an extended period, making them a stable and reliable choice for production environments.

Key features and improvements of Databricks Runtime 9.1 LTS:

• Apache Spark 3.1.2: Includes all fixes and improvements from Databricks Runtime 9.0, along with additional bug fixes and enhancements specific to Spark 3.1.2.
• Photon Public Preview: Photon is a high-performance query engine for Databricks that significantly accelerates data processing and analytics workloads.
• Machine Learning Improvements: Databricks Runtime 9.1 LTS ML includes features like improved support for unsupervised learning, expanded PySpark data types, and enhancements to the Databricks Feature Store.
• Autologging (Public Preview): This feature automatically tracks machine learning experiments, capturing model parameters, metrics, files, and lineage information.

How to use Databricks Runtime 9.1 LTS:

1. Cluster Configuration: When creating or editing a Databricks cluster, select “9.1 LTS” (or “9.1 LTS ML” for machine learning workloads) from the Databricks Runtime version dropdown menu.
2. Notebook Execution: Once your cluster is running the desired runtime version, you can start developing and executing your Databricks notebooks using the features and functionalities of Databricks Runtime 9.1 LTS.