dry-run Consider the scenario where many jobs/clusters share the same DBFS init script: do not create a copy of the same script for each cluster/job.

A Python library for conveniently caching PySpark DataFrames to DBFS (Databricks File System). As opposed to Spark caching or Databricks disk cache, this will persist your dataframe to a permanent ...