In this section:

llm.enabled

This setting specifies if the LLM functionality is enabled.

Acceptable Values

trueThe LLM functionality is enabled.
falseDefault. The LLM functionality is disabled.

Example Usage

  • llm.enabled=true


llm.provider

This setting specifies which LLM provider is used.

Acceptable Values

openaiDefault.
azure.openai
other.llm

Example Usage

llm.provider=azure.openai

openai.organization.id

(Optional) This setting specifies the organization ID for accessing the OpenAI client. If no Organization ID is supplied, the default organization ID for your account will be used.

Acceptable Values

[ID]The organization ID for accessing the OpenAI client.

Example Usage

openai.organization.id=parasoft


openai.api.key

This setting specifies your OpenAI token.

Acceptable Values

[key]Your OpenAI token.

Example Usage

openai.api.key=9sd8yfa8vfaebfeawpf9


openai.model

This setting specifies the name of your OpenAI chat model.

Acceptable Values

[chat model]Your OpenAI chat model.

Example Usage

openai.model=gpt-4o


openai.embedding.model

This setting specifies the name of your OpenAI embedding chat model.

Acceptable Values

[chat model]Your OpenAI embedding chat model.

Example Usage

openai.embedding.model=text-embedding-ada-002


azure.openai.resource.name

This setting specifies the Azure resource that contains your deployed Azure OpenAI model.

Acceptable Values

[resource name]The resource name for your Azure OpenAI deployment.

Example Usage

azure.openai.resource.name=my-azure-openai-resource


azure.openai.deployment.id

This setting specifies the deployment ID of your Azure OpenAI chat model.

Acceptable Values

[ID]The deployment ID for your Azure OpenAI chat model.

Example Usage

azure.openai.deployment.id=gpt-4-chat


azure.openai.embedding.deployment.id

This setting specifies the deployment ID of your Azure OpenAI chat model.

Acceptable Values

[ID]The deployment ID for your Azure OpenAI embedding chat model.

Example Usage

azure.openai.embedding.deployment.id=text-embedding-ada-002


azure.openai.api.key

This setting specifies your Azure OpenAI token.

Acceptable Values

[key]Your Azure OpenAI token.

Example Usage

azure.openai.api.key=3d7c9e5f4e8b4f5ab1234567890abcdef


other.llm.base.url

This setting specifies the URL of the location where your LLM model is deployed.

Acceptable Values

[URL]The base URL for your custom LLM provider.

Example Usage

other.llm.base.url=https://api.custom-llm-provider.com/


other.llm.api.key

This setting specifies your custom LLM provider token.

Acceptable Values

[key]Your custom LLM provider token.

Example Usage

other.llm.api.key=hf_yJkF7s2FEXAMPLETOKENeZ4rT


other.llm.model

This setting specifies the chat model to use for your custom LLM provider.

Acceptable Values

[chat model]The name of your LLM chat model.

Example Usage

other.llm.model=llama2-13b-chat


other.llm.embedding.model

(Optional) This setting specifies the embedding chat model to use for your custom LLM provider.

Acceptable Values

[chat model]The name of your LLM embedding chat model.

Example Usage

other.llm.embedding.model=bge-base-en-v1.5

  • No labels