In this section:
llm.enabled
This setting specifies if the LLM functionality is enabled.
Acceptable Values
| true | The LLM functionality is enabled. |
|---|---|
| false | Default. The LLM functionality is disabled. |
Example Usage
llm.enabled=true
llm.provider
This setting specifies which LLM provider is used.
Acceptable Values
| openai | Default. |
|---|---|
| azure.openai | |
| other.llm |
Example Usage
llm.provider=azure.openai
openai.organization.id
(Optional) This setting specifies the organization ID for accessing the OpenAI client. If no Organization ID is supplied, the default organization ID for your account will be used.
Acceptable Values
| [ID] | The organization ID for accessing the OpenAI client. |
|---|
Example Usage
openai.organization.id=parasoft
openai.api.key
This setting specifies your OpenAI token.
Acceptable Values
| [key] | Your OpenAI token. |
|---|
Example Usage
openai.api.key=9sd8yfa8vfaebfeawpf9
openai.model
This setting specifies the name of your OpenAI chat model.
Acceptable Values
| [chat model] | Your OpenAI chat model. |
|---|
Example Usage
openai.model=gpt-4o
openai.embedding.model
This setting specifies the name of your OpenAI embedding chat model.
Acceptable Values
| [chat model] | Your OpenAI embedding chat model. |
|---|
Example Usage
openai.embedding.model=text-embedding-ada-002
azure.openai.resource.name
This setting specifies the Azure resource that contains your deployed Azure OpenAI model.
Acceptable Values
| [resource name] | The resource name for your Azure OpenAI deployment. |
|---|
Example Usage
azure.openai.resource.name=my-azure-openai-resource
azure.openai.deployment.id
This setting specifies the deployment ID of your Azure OpenAI chat model.
Acceptable Values
| [ID] | The deployment ID for your Azure OpenAI chat model. |
|---|
Example Usage
azure.openai.deployment.id=gpt-4-chat
azure.openai.embedding.deployment.id
This setting specifies the deployment ID of your Azure OpenAI chat model.
Acceptable Values
| [ID] | The deployment ID for your Azure OpenAI embedding chat model. |
|---|
Example Usage
azure.openai.embedding.deployment.id=text-embedding-ada-002
azure.openai.api.key
This setting specifies your Azure OpenAI token.
Acceptable Values
| [key] | Your Azure OpenAI token. |
|---|
Example Usage
azure.openai.api.key=3d7c9e5f4e8b4f5ab1234567890abcdef
other.llm.base.url
This setting specifies the URL of the location where your LLM model is deployed.
Acceptable Values
| [URL] | The base URL for your custom LLM provider. |
|---|
Example Usage
other.llm.base.url=https://api.custom-llm-provider.com/
other.llm.api.key
This setting specifies your custom LLM provider token.
Acceptable Values
| [key] | Your custom LLM provider token. |
|---|
Example Usage
other.llm.api.key=hf_yJkF7s2FEXAMPLETOKENeZ4rT
other.llm.model
This setting specifies the chat model to use for your custom LLM provider.
Acceptable Values
| [chat model] | The name of your LLM chat model. |
|---|
Example Usage
other.llm.model=llama2-13b-chat
other.llm.embedding.model
(Optional) This setting specifies the embedding chat model to use for your custom LLM provider.
Acceptable Values
| [chat model] | The name of your LLM embedding chat model. |
|---|
Example Usage
other.llm.embedding.model=bge-base-en-v1.5