Skip to content

Databricks

Steps to setup Databricks

Fill the form with the credentials of your data source.

Screenshot Screenshot

Once the form is completed, it's necessary to test the connection to verify if Qualytics is able to connect to your source of data. A successful message will be shown:

Screenshot Screenshot

Warning

By clicking on the Finish button, it will create the Datastore and skipping the configuration of an Enrichment Datastore.

  • To configure an Enrichment Datastore in another moment, please refer to this section

Note

It is important to associate an Enrichment Datastore with your new Datastore

  • The Enrichment Datastore will allow Qualytics to record enrichment data, copies of the source anomalous data and additional metadata for your Datastore

Configuring an Enrichment Datastore

  • If you have an Enrichment Datastore already setup, you can link it by enable to use an existing Enrichment Datastore and select from the list

  • If you don't have an Enrichment Datastore, you can create one at the same page:

    Screenshot Screenshot

Once the form is completed, it's necessary to test the connection. A successful message will be shown:

Screenshot Screenshot

Warning

By clicking on the Finish button, it will create the Datastore and link or create the Enrichment Datastore

Fields

Name required

  • The datastore name to be created in Qualytics App.

Server Hostname required

  • The address of the server to connect to.

Http Path required

  • The Databricks compute resources URL.

Catalog optional

  • The Catalog name to be accessed.

  • You can return the list of catalogs running:

    SHOW CATALOGS [ LIKE regex_pattern ]

Database optional

  • The database name to be accessed.

  • You can return the list of databases running:

    SHOW SCHEMAS [ LIKE regex_pattern ]

Personal Access Token required

Information on how to retrieve the connection details

This section explains how to retrieve the connection details that you need to connect to Databricks.

  • Get connection details for a cluster

    1. Click Compute in the sidebar.
    2. Choose a cluster to connect to.
    3. Navigate to Advanced Options.
    4. Click on the JDBC/ODBC tab.
    5. Copy the connection details.

  • Get connection details for a SQL warehouse

    1. Click SQL Warehouses in the sidebar.
    2. Choose a warehouse to connect to.
    3. Navigate to the Connection Details tab.
    4. Copy the connection details.
Last update: September 29, 2023