You can still develop Scala 3 applications and run them on a Databricks cluster by following these steps:

1. Use a Compatible Spark Version: Ensure you are using Spark 3.2.0 or later, as these versions are built with Scala 2.13, which is compatible with Scala 3.
2. Choose the Right Runtime: When creating or selecting a cluster on Databricks, opt for a runtime that includes Spark 3.2.0 (or newer) and Scala 2.13. While Databricks may not explicitly offer a Scala 3 runtime, the Scala 2.13 runtime will be sufficient.
3. Build Your Scala 3 Application: Develop your Scala 3 application using your preferred tools and libraries. Make sure to include the necessary Spark dependencies.
4. Deploy and Run: Deploy your compiled Scala 3 application (JAR file) to the Databricks cluster and run it like any other Spark application.

Resources:

• Databricks for Scala Developers: https://docs.databricks.com/en/languages/scala.html
• Using Scala 3 with Spark: https://xebia.com/blog/using-scala-3-with-spark/

Additional Notes:

• Community Support: The Scala and Spark communities are actively working on improving Scala 3 compatibility. Check forums and blogs for updates and best practices.
• Databricks Connect: If you prefer to develop locally, Databricks Connect allows you to connect your local development environment to a Databricks cluster, making testing and deploying your Scala 3 applications easier.