OpenAI API response discrepancies between Azure OpenAI Playground and chat/completions

[psubbarao]

Please provide us with the following information:

This issue is for a: (mark with an x)

- [X] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

1. I've uploaded a collection of documents to blob storage and indexed them using Azure Search service.
2. I've begun querying these documents with various questions using Azure OpenAI playground, and I'm receiving accurate responses.
3. However, when I utilize the Azure.AI.OpenAI client to pose the same questions, the responses are not as expected. Some questions yield no information at all, whereas they provide appropriate responses in the OpenAI playground.

Any log messages given by the failure

Here are my Chat Completion Options, which are same as configured in OpenAI playground:

ChatCompletionsOptions options = new()
{
    DeploymentName = _modelName,
    Messages =
    {
        systemMessage,
        userMessage
    },
    User = sessionId,
    AzureExtensionsOptions = new AzureChatExtensionsOptions()
    {
        Extensions = {
            new AzureSearchChatExtensionConfiguration() {
                SearchEndpoint = new Uri(_searchIndexEndpoint),
                IndexName = _searchIndexName,
                Authentication = new OnYourDataApiKeyAuthenticationOptions(_searchIndexApiAccessKey),
                Strictness = 3,
                DocumentCount = 5,
                ShouldRestrictResultScope = true
            }
        }
    },
    MaxTokens = 800,
    Temperature = 0.2f,
    NucleusSamplingFactor = 1f,
    FrequencyPenalty = 0,
    PresencePenalty = 0
}

Expected/desired behavior

OS and Version?

Windows 10 Enterprise

Versions

22H2

Mention any other details that might be useful

---

Thanks! We'll be in touch soon.

[markjbrown]

@psubbarao, I'm not clear what this is. The code you are sharing here is not in this project.