Edit

Share via


Configure data flow endpoints for Microsoft Fabric Real-Time Intelligence

To send data to Microsoft Fabric Real-Time Intelligence from Azure IoT Operations, you can configure a data flow endpoint. This configuration allows you to specify the destination endpoint, authentication method, topic, and other settings.

Prerequisites

Note

Event Stream supports multiple input sources including Azure Event Hubs. If you have an existing data flow to Azure Event Hubs, you can bring that into Fabric as shown in the Quickstart. This article shows you how to flow real-time data directly into Microsoft Fabric without any other hops in between.

Retrieve custom endpoint connection details

Retrieve the Kafka-compatible connection details for the custom endpoint. The connection details are used to configure the data flow endpoint in Azure IoT Operations.

  1. The connection details are in the Fabric portal under the Destinations section of your event stream.

  2. In the details panel for the custom endpoint, select Kafka protocol.

  3. Select the SAS Key Authentication section to view the connection details.

  4. Copy the details for the values for the Bootstrap server, Topic name, and Connection string-primary key. You use these values to configure the data flow endpoint.

    Screenshot in Microsoft Fabric that has the custom endpoint connection details.

    Settings Description
    Bootstrap server The bootstrap server address is used for the hostname property in data flow endpoint.
    Topic name The event hub name is used as the Kafka topic and is of the the format es_aaaaaaaa-0000-1111-2222-bbbbbbbbbbbb.
    Connection string-primary key The connection string with the primary key.

Create a Microsoft Fabric Real-Time Intelligence data flow endpoint

To configure a data flow endpoint for Microsoft Fabric Real-Time Intelligence, you need to use Simple Authentication and Security Layer (SASL) based authentication.

Azure Key Vault is the recommended way to sync the connection string to the Kubernetes cluster so that it can be referenced in the data flow. Secure settings must be enabled to configure this endpoint using the operations experience web UI.

  1. In the IoT Operations experience portal, select the Data flow endpoints tab.

  2. Under Create new data flow endpoint, select Microsoft Fabric Real-Time Intelligence > New.

  3. Enter the following settings for the endpoint.

    Screenshot using operations experience to create a new Fabric Real-Time Intelligence data flow endpoint.

    Setting Description
    Name The name of the data flow endpoint.
    Host The hostname of the event stream custom endpoint in the format *.servicebus.windows.net:9093. Use the bootstrap server address noted previously.
    Authentication method SASL is currently the only supported authentication method.
    SASL type Choose Plain
    Synced secret name Enter a name for the synced secret. A Kubernetes secret with this name is created on the cluster.

    Select Add reference to create a new or choose an existing Key Vault reference for the username and password references.

    For Username reference of token secret, the secret value must be exactly the literal string $ConnectionString not an environmentent variable reference.

    Screenshot to create a username reference in Azure Key Vault.

    For Password reference of token secret, the secret value must be the connection string with the primary key from the event stream custom endpoint.

    Screenshot to create a password reference in Azure Key Vault.

  4. Select Apply to provision the endpoint.

Advanced settings

The advanced settings for this endpoint are identical to the advanced settings for Azure Event Hubs endpoints.

Next steps

To learn more about data flows, see Create a data flow.