newly deployed cohere model not returning content though giving 200

Question

newly deployed cohere model not returning content though giving 200

Dileep Ponna 0

INFO:main:Requesting embedding from endpoint: https://ai-hubhyperbrane732453665666.services.ai.azure.com/models

INFO:main:Model name: Cohere-embed-v3-english

INFO:azure.core.pipeline.policies.http_logging_policy:Request URL: 'https://ai-hubhyperbrane732453665666.services.ai.azure.com/models/embeddings?api-version=REDACTED'

Request method: 'POST'

Request headers:

'Content-Type': 'application/json'

'Content-Length': '99'

'Accept': 'application/json'

'x-ms-client-request-id': '82da5db2-27e2-11f0-a661-8c85907d9acc'

'api-key': 'REDACTED'

'User-Agent': 'azsdk-python-ai-inference/1.0.0b9 Python/3.9.6 (macOS-13.7.5-x86_64-i386-64bit)'

'Authorization': 'REDACTED'

A body is sent with the request

INFO:azure.core.pipeline.policies.http_logging_policy:Response status: 200

Response headers:

'Content-Length': '0'

'apim-request-id': 'REDACTED'

'Strict-Transport-Security': 'REDACTED'

'x-content-type-options': 'REDACTED'

'x-ms-region': 'REDACTED'

'Date': 'Sat, 03 May 2025 05:50:25 GMT'

ERROR:main:Error generating embedding: Expecting value: line 1 column 1 (char 0)

Failed to generate embedding: Expecting value: line 1 column 1 (char 0)

Prashanth Veeragoni 4,105 Reputation points Microsoft External Staff

2025-05-05T01:15:51.0733333+00:00
Hi Dileep Ponna,

The issue you're facing is a silent failure where your request to the Cohere model via Azure AI returns a 200 OK HTTP status code, but the response body is empty (Content-Length: 0). That’s why the code crashes when trying to parse the JSON response — there's nothing to parse.

This usually happens in Azure AI Services when:

·       The model is not fully ready or deployed incorrectly.

·       The request is hitting an endpoint that doesn’t properly route to the model's /embeddings operation.

·       A wrong API version or incorrect model name or capability is used.

·       Cohere model is not compatible with the embeddings operation as invoked (especially if it's not an Azure-native model).

Steps to Fix:

1.Double-check endpoint and route

Ensure the full endpoint includes /embeddings, like:

https://<resource-name>.services.azure.com/openai/deployments/<deployment-name>/embeddings?api-version=2024-02-15-preview

If you're calling just /models/embeddings, that might not route correctly for Cohere.

2.Verify model capabilities

Check if the Cohere-embed-v3-english model is actually registered to serve embedding tasks. Use the Azure CLI or REST to list models and capabilities:

az ai model list --resource-group <rg> --workspace-name <workspace>

Look for the task: embedding capability under the model metadata.

3.Use latest supported api-version

Use a supported preview version like 2024-02-15-preview instead of an old or redacted one.

4.Test with simple curl/postman

Try sending a simple POST manually:

curl -X POST https://<endpoint>/openai/deployments/<deployment>/embeddings?api-version=2024-02-15-preview \ -H "api-key: <your-key>" \ -H "Content-Type: application/json" \ -d '{"input": ["Hello world"]}'

If this still returns 200 and empty — then either:

·       The model deployment is broken,

·       OR you're hitting the wrong route.

Hope this helps, do let me know if you have any further queries.

Thank you!
Prashanth Veeragoni 4,105 Reputation points Microsoft External Staff

2025-05-06T01:04:00.8533333+00:00

Hi Dileep Ponna,

Following up to see if the above suggestion was helpful. And, if you have any further query do let me know.

Thank you!
Prashanth Veeragoni 4,105 Reputation points Microsoft External Staff

2025-05-07T02:31:20.51+00:00

Hi Dileep Ponna,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Thank you!

Your answer

Prashanth Veeragoni 4,105 Reputation points Microsoft External Staff

2025-05-06T01:04:00.8533333+00:00

Hi Dileep Ponna,

Following up to see if the above suggestion was helpful. And, if you have any further query do let me know.

Thank you!
Prashanth Veeragoni 4,105 Reputation points Microsoft External Staff

2025-05-07T02:31:20.51+00:00

Hi Dileep Ponna,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Thank you!

Share via

newly deployed cohere model not returning content though giving 200

Your answer