Bring your own model (BYOM)

PolyAI supports bring-your-own-model (BYOM) with a simple API integration. If you run your own LLM, expose an endpoint that follows the OpenAI chat/completions schema and PolyAI will treat it like any other provider.

Overview

API endpoint

{
  "model": "your-model-id",
  "messages": [
    { "role": "system", "content": "You are a helpful assistant." },
    { "role": "user", "content": "What's the weather today?" }
  ],
  "temperature": 0.7,
  "top_p": 1.0,
  "stream": false
}

Authentication

Configure your server to accept one of the above.

Sample implementation (Python / Flask)

from flask import Flask, request, jsonify
import time, uuid
app = Flask(__name__)
@app.route('/chat/completions', methods=['POST'])
def chat_completions():
    data = request.json
    messages = data.get('messages', [])
    user_input = messages[-1]['content'] if messages else ''
    # Replace with your model inference logic
    reply = f'You said: {user_input}'
    return jsonify({
        'id': f'chatcmpl-{uuid.uuid4().hex}',
        'object': 'chat.completion',
        'created': int(time.time()),
        'model': 'my-llm',
        'choices': [{
            'index': 0,
            'message': { 'role': 'assistant', 'content': reply },
            'finish_reason': 'stop'
        }]
    })

Final checklist

Before going live, verify all of the following:

• Endpoint reachable with POST.
• Request/response match OpenAI chat/completions schema.
• Authentication header configured (API Key or Bearer token).
• (Optional) Streaming supported if needed.

Send the following to your PolyAI representative to complete setup:

• Endpoint URL
• Model ID
• Auth method & credential

Related pages