Lucidum has been acquired by Cyderes → [Read the announcement]

Lucidum has been acquired by Cyderes → [Read the announcement]

View Categories

Quick Start: Understanding Data in Your Lucidum System

Estimated Reading Time: 5 min read

The following sections provide the steps to quickly find and examine the data in your Lucidum system.

Determining Which Data Sources (Connectors) Exist in Your Enviroment #

There are two ways to determine which Connectors are ingesting data:

  • Data Sources page
  • Query Tool

Data Sources #

The Data Sources page displays all the data sources (Connectors) that contribute data to asset records and all the data sources (Connectors) that contribute data to user records.

To view all the Connectors that contribute to asset records:

  1. Go to Data Sources (the database icon in the left nav pane).
  2. In the Data Sources page, click the Assets tab.

    viewing_data_data_sources_assets_27.0.png

  3. Each item in the Asset Data Source column is a Connector or a Connector and a service. For example, Azure Virtual Machines uses the Azure Connector with the Virtual Machines service toggled on.

    azure_connector_services_27.0.png

  4. Scrolling through the Data Sources pages provides a list of Connectors that contribute to asset records.

To view all the Connectors that contribute to user records:

  1. Go to Data Sources (the database icon in the left nav pane).
  2. In the Data Sources page, click the Users tab.

    viewing_data_data_sources_users_27.0.png

  3. Each item in the User Data Source column is a Connector or a Connector and a service.
  4. Scrolling through the Data Sources pages provides a list of Connectors that contribute to user records.

Query Tool #

Another way to view the available data sources (Connectors) for assets and for users is through the Query Tool.

To use the Query Tool to find all the data sources for assets:

  1. Click the Query button in the upper right corner of all pages.
  2. Select the following:

    viewing_data_asset_query_tool_27.0.png

    • Data Type. Select Asset.
    • Time Range. Select Current.
  3. Click Next.
  4. In the Build a Current Asset Query page, enter the following:

    viewing_data_asset_query_tool2_27.0.png

    • Field. Select Data Sources
    • match. Select match.
    • Click on the empty field to the right to view a list of available Data Source (Connectors) for assets.

To use the Query Tool to find all the data sources for users:

  1. Click the Query button in the upper right corner of all pages.
  2. Select the following:

    viewing_data_user_query_tool_27.0.pn

    • Data Type. Select User.
    • Time Range. Select Current.
  3. Click Next.
  4. In the Build a Current User Query page, enter the following:

    viewing_data_user_query_tool2_27.0.png

    • Field. Select Data Sources
    • match. Select match.
    • Click on the empty field to the right to view a list of available Data Source (Connectors) for users.

Viewing the Semi-Raw Data Provided by Each Connector #

All the data in Lucidum has been passed through Lucidum AI/ML before it reaches the Lucidum UI. However, there are some fields that further processed and then included in the Lucidum Data Group. Other fields are not further processed but are stored in Lucidum, are viewable in the UI, but are not included in the Lucidum Data Group. These fields are semi-raw data.

The Data Sources page displays all the data sources (Connectors) that contribute data to asset records and all the data sources (Connectors) that contribute data to user records. For each data source, the Data Sources page also displays the list of fields ingested by the Connector. Some of these fields are included in the Lucidum Data Group and some are not.

To view the data ingested by each Connector that contributes to asset records:

  1. Go to Data Sources (the database icon in the left nav pane).
  2. In the Data Sources page, click the Assets tab.

    viewing_data_data_sources_assets_27.0.png

  3. Each item in the Asset Data Source column is a Connector or a Connector and a service. For example, Azure Virtual Machines uses the Azure Connector with the Virtual Machines service toggled on.

    azure_connector_services_27.0.png

  4. Find the Data Sources you are interested in and click the Ingested Fields column.

    viewing_data_data_sources_assets_ingested_fields_27.0.png

  5. The Fields in Data Source page displays a list of each field ingested by the Connector.

    viewing_data_assets_fields_in_data_source_27.0.png

  6. Some of the fields in this page are included in the Lucidum Data Group. Some are not.
  7. If the Unique Count field includes a value, for assets that use the Connector, Lucidum ingests this field only from this Connector.

NOTE: To view a list of asset records that use data from a Connector, click on the Connector name in the User Data Source column.

To view the data ingested by each Connector that contributes to user records:

  1. Go to Data Sources (the database icon in the left nav pane).
  2. In the Data Sources page, click the Users tab.

    viewing_data_data_sources_users_27.0.png

  3. Each item in the User Data Source column is a Connector or a Connector and a service.
  4. Find the Data Sources you are interested in and click the Ingested Fields column.

    viewing_data_data_sources_users_ingested_fields_27.0.png

  5. The Fields in Data Source page displays a list of each field ingested by the Connector.

    viewing_data_users_fields_in_data_source_27.0.png

  6. Some of the fields in this page are included in the Lucidum Data Group. Some are not.
  7. If the Unique Count field includes a value, for users that use the Connector, Lucidum ingests this field only from this connector.

NOTE: To view a list of user records that use data from a Connector, click on the Connector name in the User Data Source column.

Semi-Raw Data in the Query Tool #

Some of the semi-raw fields appear in the Query Tool, even though they are not part of the Lucidum Data Group.

viewing_data_query_tool_data_source_details_27.0.png

These fields appear as:

Data Source Details::<field value>

You can use these fields in queries, SmartLabels, Dashboards, and Actions.

Viewing All the Available Data in the Lucidum Data Group #

To view all the available fields in the Lucidum Data Group, you can view the details of any asset or any user.

To do this for assets:

  1. Click the Query button in the upper right corner of all pages.
  2. Select the following:

    viewing_data_asset_query_tool_27.0.png

    • Data Type. Select Asset.
    • Time Range. Select Current.
  3. Click Next.
  4. In the Build a Current Asset Query page, enter the following:

    viewing_data_asset_query_tool3_27.0.png

    • Field. Select Lucidum Asset Name
    • match. Select exists.
    • All assets in Lucidum are assigned the Lucidum Asset Name. So this query is an easy way to view all assets in Lucidum.
  5. Click the Show Results icon in the lower left of the Query Tool.
  6. In the Query Results page, for any asset, click the > icon.

    viewing_data_asset_query_results_27.0.png

  7. In the Viewing Details page, select the Lucidum Data Group tab.

    viewing_data_asset_viewing_details_27.0.png

  8. Toggle on Show Fields With No Content. This allows you to view the list of all fields in the Lucidum Data Group, even if Lucidum did not find a value on the selected asset.
  9. Use the categories on the left to view the list of fields in the Lucidum Data Group.

To do this for users:

  1. Click the Query button in the upper right corner of all pages.
  2. Select the following:

    viewing_data_user_query_tool_27.0.png

    • Data Type. Select User.
    • Time Range. Select Current.
  3. Click Next.
  4. In the Build a Current Asset Query page, enter the following:

    viewing_data_user_query_tool3_27.0.png

    • Field. Select Lucidum User Name.
    • match. Select exists.
    • All users in Lucidum are assigned the Lucidum User Name. So this query is an easy way to view all users in Lucidum.
  5. Click the Show Results icon in the lower left of the Query Tool.
  6. In the Query Results page, for any user, click the > icon.

    viewing_data_user_query_results_27.0.png

  7. In the Viewing Details page, select the Lucidum Data Group tab.

    viewing_data_user_viewing_details_27.0.png

  8. Toggle on Show Fields With No Content. This allows you to view the list of all fields in the Lucidum Data Group, even if Lucidum did not find a value on the selected user account.
  9. Use the categories on the left to view the list of fields in the Lucidum Data Group.

Viewing the Data in the Lucidum Data Group for a Single Asset #

For details about viewing the data for a single asset, see Viewing Enriched Data.

Viewing the Semi-Raw Data for a Single Asset #

For details about viewing the data for a single asset, see Viewing Semi-Raw Data from the Data Source Tab.

What are your Feelings