Edit

Share via

Add Azure Data Explorer Database (DB) source to an eventstream (preview)  

  • Article

This article shows you how to add an Azure Data Explorer DB source to an eventstream. 

Azure Data Explorer is a fully managed, high-performance platform that delivers real-time insights from massive streaming data. Microsoft Fabric event streams enable you to connect to an Azure Data Explorer database, stream the data from its tables, and route them to various destinations within Fabric.

Note

This source isn't supported in the following regions of your workspace capacity: West US3, Switzerland West.  

Prerequisites  

Before you start, you must complete the following prerequisites:

  • Access to the Fabric premium workspace with Contributor or higher permissions.  
  • Ensure that you have an active Azure subscription and an Azure Data Explorer cluster with at least one database deployed.
  • Ensure that you have the required permissions to access the Azure Data Explorer cluster.
  • Ensure that the Azure Data Explorer cluster is publicly accessible and not restricted by a firewall or a virtual network. 

Note

The maximum number of sources and destinations for one eventstream is 11.

Add Azure Data Explorer DB as a source  

If you haven't added any source to your eventstream yet, select Use external source tile.

Screenshot that shows the selection of Use external source tile.

If you're adding the source to an already published eventstream, switch to Edit mode, select Add source on the ribbon, and then select External sources.

Screenshot that shows the selection of Add source to External sources menu.  

On the Select a data source page, search for and select Connect on the Azure Data Explorer DB tile.

Screenshot that shows the selection of Azure Data Explorer as the source type in the Get events wizard.

Configure and connect to Azure Data Explorer DB

  1. On the Configure connection settings page, select New connection.

    Screenshot that shows the Configuration connection settings page.

  2. In the Connection settings section of the popup window, do these steps:

    1. For Cluster, enter the Cluster URI of your Azure Data Explorer cluster.

    2. For Database, enter your database name.

    3. For Table, enter single or multiple table names. 

      Note

      Database and table in the cloud connection aren't mandatory, as you can also specify them later in the next step of the wizard. The Cluster is required.

    4. For Connection name, enter a name for the connection to the Azure Data Explorer Cluster. 

    5. For Authentication kind, only Organizational account is currently supported.

    6. Then, select Connect.

      Screenshot that shows the connection settings and credentials.

  3. Now, on Configure connection settings page, follow these steps if you didn't specify the database and tables in the connection settings earlier.

    1. For Database, enter the name of your database.

    2. Then, enter names of tables (one or more).

      Note

      The Database and table names configured in this step take precedence over the settings you set in the cloud connection settings you configured earlier.

      Screenshot that shows the connection settings completed.

  4. If you're using Real-Time hub, follow these steps. Otherwise, move to the next step.

    1. In the Stream details section to the right, select the Fabric workspace where you want to save the eventstream that the Wizard is going to create.

    2. For eventstream name, enter a name for the eventstream. The wizard creates an eventstream with the selected Azure Database Explorer table as a source.

    3. The Stream name is automatically generated for you by appending -stream to the name of the eventstream. You can see this stream on the Real-time hub All data streams page when the wizard finishes.

      Screenshot that shows the Stream details section for the Azure Data Explorer connection settings.

  5. If you're using the Eventstream editor to add an Azure Data Explorer database table as a source to an event stream, select pencil button under Source name, and enter a source name.

    Screenshot that shows the Stream details section.

  6. Select Next at the bottom of the page.

  7. On the Review + connect page, review settings, and select Connect (Fabric Real-Time hub) or Add (Fabric Eventstream).

    Screenshot that shows the Review + connect page for Azure Data Explorer connector.

View updated eventstream

  1. You see that the Azure Data Explorer DB source is added to your eventstream on the canvas in the Edit mode.  To implement this newly added Azure Data Explorer DB source, select Publish.

    Screenshot that shows the editor with Publish button selected.

  2. After you complete these steps, your Azure Data Explorer DB source is available for visualization in the Live view. 

    Screenshot that shows the editor in the live view.

    Note

    When the Azure Data Explorer DB streaming connector starts, it captures only new table changes. Historical table data aren't streamed into Eventstream.

Related content

To learn how to add other sources to an eventstream, see the following article: Add and manage an event source in an eventstream.