Databricks Labs

All

38 repositories

lakebridge
Public
Accelerates migrations to Databricks by automating key migration activities
reconciliation data-validation code-analysis transpiler databricks code-converter
Python
•
Other
•53•87•421•29•Updated Jul 2, 2025Jul 2, 2025
lsql
Public
Lightweight SQL execution wrapper only on top of Databricks SDK
databricks databricks-sql databricks-sdk
Python
•
Other
•5•18•55•8•Updated Jul 2, 2025Jul 2, 2025
tempo
Public
API for manipulating time series on top of Apache Spark: lagged time values, rolling statistics (mean, avg, sum, count, etc), AS OF joins, downsampling, and interpolation
python scala timeseries-data timeseries-analysis data-science timeseries time-series pandas data-analysis
Jupyter Notebook
•
Other
•57•325•29•1•Updated Jul 2, 2025Jul 2, 2025
mcp
Public
Python
•
Other
•17•51•8•2•Updated Jul 1, 2025Jul 1, 2025
ucx
Public
Automated migrations to Unity Catalog
databricks unity-catalog databricks-cli-installable databricks-governance
Python
•
Other
•96•284•401•21•Updated Jul 1, 2025Jul 1, 2025
sandbox
Public
Experimental labs projects
databricks databricks-api databricks-sdk
Python
•
Other
•19•36•26•12•Updated Jul 1, 2025Jul 1, 2025
dqx
Public
Databricks framework to validate Data Quality of pySpark DataFrames
spark spark-streaming databricks data-quality-checks data-quality data-profiling dlt data-quality-monitoring
Python
•
Other
•44•283•40•1•Updated Jul 1, 2025Jul 1, 2025
brickster
Public
R Toolkit for Databricks
R
•
Apache License 2.0
•12•67•4•0•Updated Jul 1, 2025Jul 1, 2025
kasal
Public
Python
•1•28•22•0•Updated Jun 27, 2025Jun 27, 2025
dbldatagen
Public
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines
spark faker pyspark spark-streaming data-generation databricks synthetic-data datagen datagenerator deltalake
Python
•
Other
•75•411•15•14•Updated Jun 26, 2025Jun 26, 2025
blueprint
Public
Baseline for Databricks Labs projects written in Python
python cli databricks databricks-cli-installable
Python
•
Other
•10•46•17•4•Updated Jun 26, 2025Jun 26, 2025
access-insights
Public
Python
•
Other
•0•2•0•0•Updated Jun 25, 2025Jun 25, 2025
mosaic
Public
An extension to the Apache Spark framework that allows easy and fast processing of very large geospatial datasets.
Jupyter Notebook
•
Other
•78•298•62•18•Updated Jun 6, 2025Jun 6, 2025
pytester
Public
Python Testing for Databricks
python3 pytest pytest-plugin databricks databricks-sdk
Python
•
Other
•9•87•39•1•Updated May 27, 2025May 27, 2025
dlt-meta
Public
Metadata driven Databricks Delta Live Tables framework for bronze/silver pipelines
python databricks meta-programming dlt
Python
•
Other
•90•202•26•0•Updated May 22, 2025May 22, 2025
discoverx
Public
A Swiss-Army-knife for your Data Intelligence platform administration.
scanning data-retrieval pii-detection semantic-classification multi-table-operations
Python
•
Other
•15•120•17•10•Updated Apr 30, 2025Apr 30, 2025
dbx
Public
🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.
ci cicd databricks mlops databricks-cli databricks-api
Python
•
Other
•125•449•91•5•Updated Apr 22, 2025Apr 22, 2025
splunk-integration
Public
Databricks Add-on for Splunk
cybersecurity databricks databricks-notebooks splunk-addon
Python
•
Other
•18•27•16•2•Updated Mar 13, 2025Mar 13, 2025
partner-connect-api
Public
Scala
•
Other
•4•12•1•11•Updated Jan 31, 2025Jan 31, 2025
overwatch
Public
Capture deep metrics on one or all assets within a Databricks workspace
monitoring databricks
Scala
•
Other
•70•232•134•9•Updated Nov 20, 2024Nov 20, 2024
pylint-plugin
Public
Databricks Plugin for PyLint
python databricks pylint-plugin
Python
•
Other
•4•26•11•1•Updated Nov 15, 2024Nov 15, 2024
tika-ocr
Public
Rich Text Format
•
Other
•3•20•2•5•Updated Oct 21, 2024Oct 21, 2024
geoscan
Public
Geospatial clustering at massive scale
library spark-ml clustering
Scala
•
Other
•19•101•2•6•Updated Jul 11, 2024Jul 11, 2024
waterbear
Public
Automated provisioning of an industry Lakehouse with enterprise data model
python sql spark data-model databricks delta-lake lakehouse
Python
•
Other
•3•9•0•1•Updated Jul 11, 2024Jul 11, 2024
dataframe-rules-engine
Public
Extensible Rules Engine for custom Dataframe / Dataset validation
Scala
•
Other
•31•135•8•4•Updated May 7, 2024May 7, 2024
databricks-sdk-r
Public
Databricks SDK for R (Experimental)
data-science r sdk databricks
R
•
Apache License 2.0
•4•21•6•1•Updated Apr 8, 2024Apr 8, 2024
delta-sharing-java-connector
Public
A Java connector for delta.io/sharing/ that allows you to easily ingest data on any JVM.
java delta-sharing
Java
•
Apache License 2.0
•6•14•2•2•Updated Mar 25, 2024Mar 25, 2024
transpiler
Public
SIEM-to-Spark Transpiler
Scala
•
Other
•5•42•13•5•Updated Mar 18, 2024Mar 18, 2024
doc-qa
Public
Python
•
Other
•7•51•0•4•Updated Feb 23, 2024Feb 23, 2024
databricks-sync
Public
An experimental tool to synchronize source Databricks deployment with a target Databricks deployment.
Python
•
Other
•14•47•16•7•Updated Jan 21, 2024Jan 21, 2024