Databricks is deeply invested in open source and has contributed significantly to projects like Apache Spark. They offer several open-source technologies and models, making them a significant player in the open-source data and AI ecosystem.

Here’s a summary of Databricks’ open-source initiatives:

Open Source Technologies:

• Apache Spark:  The foundational technology behind Databricks, providing a unified engine for large-scale data processing.
• Delta Lake: An open-format storage layer that brings reliability and performance to data lakes.
• MLflow: An open-source platform for managing the entire machine learning lifecycle.
• Koalas: A project that allows users to work with Spark DataFrames using pandas-like APIs.

Open Source Large Language Models (LLMs):

• Dolly: A large language model designed for instruction following.
• DBRX: A recently released LLM designed for efficiency and customizability.

Resources:

• Built on Open Source: https://www.databricks.com/product/open-source
• Best-in-class open-source generative AI models for free commercial use: https://www.databricks.com/product/machine-learning/large-language-models-oss-guidance
• Announcing DBRX: https://www.databricks.com/blog/announcing-dbrx-new-standard-efficient-open-source-customizable-llms