Default AI Vendors¶
WSO2 API Manager provides built-in support for three AI/LLM vendors:
- OpenAI
- Azure OpenAI
- Mistral
These default AI vendors come pre-configured within WSO2 API Manager, enabling seamless integration with their AI models. This out-of-the-box support simplifies API creation and ensures a smooth experience when working with AI services.
Managing Default AI Vendor Configurations¶
The following configurations are read-only and you can view them by navigating to the AI/LLM Vendors section under the Admin Portal.
| Category | Field |
|---|---|
| General Details | Name API Version Description |
| LLM Configurations | Request Model Response Model Prompt Token Count Completion Token Count Total Token Count Remaining Token Count |
| LLM Provider Auth Configurations | Auth Type: Header, Query Parameter or Unsecured Auth Type Identifer: Header/Query Parameter Identifier |
| Connector Type for AI/LLM Vendor | Connector Type |
Note that the following configurations can be updated.
| Category | Field |
|---|---|
| API Definition | AI vendor exposed API definition file |
| Model List | Add the list of models supported by the AI vendor. This list enables you to configure routing stratergies within your AI APIs. |