What is Databricks? #
Databricks is a unified, open analytics platform for building, deploying, sharing, and maintaining enterprise-grade data, analytics, and AI solutions at scale. The Databricks Data Intelligence Platform integrates with cloud storage and security in your cloud account, and manages and deploys cloud infrastructure on your behalf.
Why Should You Use the Databricks Connector? #
The Databricks connector provides visibility into the assets in your environment. You can use this visibility to:
-
ensure assets are managed per your security policies
-
derive relationships between assets, users, applications, and data
How Does This Connector Work? #
Lucidum executes read-only requests to the Databricks REST API and ingests only meta-data about Databricks devices. Lucidum does not retrieve any data stored on your assets.
Configuring the Connector in Lucidum #
| Field |
Description |
Example |
|---|---|---|
|
Profile Name |
The name for this connection in Lucidum. You can have multiple profiles for Databricks. |
Production Workspace |
|
URL |
The URL for the Databricks API. For workspace, this is of the form where
|
https://databricks_prod/api |
|
API Token |
The access token for a Databricks account that has read access to the Databricks API. For details, see https://docs.databricks.com/aws/en/dev-tools/auth/pat. |
p7g444S3IZ5wmFvmzWmx14qACXdzQ25b |
Source Documentation #
Workspace Instance Name #
To find the workspace instance name:
https://docs.databricks.com/aws/en/workspace/workspace-details
Creating Credentials #
- To create a users in a workspace:
https://docs.databricks.com/aws/en/admin/users-groups/users
- To create an API Token:
For details, see https://docs.databricks.com/aws/en/dev-tools/auth/pat.
Required Permissions #
To manage permissions for your API token, see:
https://docs.databricks.com/aws/en/security/auth/api-access-permissions#pat
API Documentation #
API 2.0
https://docs.databricks.com/api/workspace/introduction
