Prompt flow

Overview

Prompt flow’s OpenAI connection supports a custom base_url. Set it to AI Sonar’s /v1 endpoint and use AI Sonar model IDs in your flow.

Type: Flow builder and evaluation platformPrimary Path: OpenAI-compatible Chat CompletionsSupport Confidence: Supported OpenAI-compatible path

Create A Connection

pf connection create \
  --file ./my_chatbot/openai.yaml \
  --set api_key=sk-your-api-key base_url=https://api.aisonar.dev/v1 \
  --name open_ai_connection

Flow Notes

In your flow.dag.yaml, keep the connection name aligned with the command above:

connection: open_ai_connection
deployment_name: claude-sonnet-5

Some Prompt flow templates call this value deployment_name because the same templates also support Azure OpenAI deployments. With AI Sonar, use the AI Sonar model ID.

Endpoint Notes

This integration uses Prompt flow’s OpenAI-compatible connection. Native AI Sonar Responses, Anthropic Messages, and Gemini routes require Prompt flow tools or custom Python nodes that call those endpoints directly.

Guardrails Promptfoo

Compatibility Matrix

Coding Tools

Native SDKs

Frameworks & Platforms

Chat Apps

Overview

Create A Connection

Flow Notes

Endpoint Notes

​Overview

​Create A Connection

​Flow Notes

​Endpoint Notes

Overview

Create A Connection

Flow Notes

Endpoint Notes