We are getting "Error 400 Bad Request" when connecting Azure Open AI using an Azure AI Index as the data source

Hi there Santini, Robert

Thanks for using QandA platform

When you set it to “Selected IP addresses,” the OpenAI service (even if it’s in Azure) can’t access it directly unless its outbound IPs are explicitly whitelisted and unfortunately, i think thew OpenAI’s outbound IPs are not published or fixed. That’s why it works when set to “All networks” but fails otherwise. Even though you have the "Allow Azure services on the trusted services list" option enabled, this doesn't cover all services OpenAI isn't guaranteed to be on that list for search access.

my suggestion s is to either keep “All networks” temporarily during testing or trysetting up a Private Endpoint,

If this helps kindly accept the answer thanks much.

Hi @Santini, Robert
Just checking in to see if above information was helpful. If you have any further updates on this issue, please feel free to post back.
Thank you for answering Azar

Thank you for your response, but that solution is not working. This is my code below:

var client = new AzureOpenAIClient(new Uri(endpointOpenAI), new ApiKeyCredential(openAiApiKey));

var chatClient = client.GetChatClient(deployment);

var messages = new List<ChatMessage>();

messages.Add(new SystemChatMessage(systemMessage));

messages.Add(new UserChatMessage(userMessage));

        ChatCompletionOptions options = new ChatCompletionOptions();

        options.AddDataSource(new AzureSearchChatDataSource()

        {

            Endpoint = new Uri(searchServiceEndpoint),

            IndexName = searchIndexName,

            Authentication = DataSourceAuthentication.FromApiKey(searchApiKey),

            Filter = "",

          });

ClientResult<ChatCompletion> response = await chatClient.CompleteChatAsync(messages, options);

var chatResponse = response.Value.Content.Last().Text;

Hi @Santini, Robert
The issue you're experiencing where the request fails with a 400 Bad Request when using Azure Cognitive Search as a data source for Azure OpenAI is related to network access restrictions on your Cognitive Search service. even though you have enabled “Allow Azure services on the trusted services list”, Azure OpenAI is not guaranteed to be included in that list for outbound access to Azure Cognitive Search. Additionally, Azure OpenAI runs in a Microsoft-managed environment and does not have static or published outbound IP addresses, so it cannot be added to your firewall using “Selected IP addresses. You can temporarily set your Azure Cognitive Search to allow All networks to verify that the configuration and code logic are working as expected.

Hi @Santini, Robert
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.