helicone | Dosu

Helicone acts as a proxy for your OpenAI API calls, enabling detailed logging and monitoring. To integrate, update your API base URL and add the Helicone-Auth header.

AI SDK by vercel#

Set Environment Variables:
- HELICONE_API_KEY
- OPENAI_API_KEY
Configure the OpenAI client:

import { createOpenAI } from "@ai-sdk/openai";
import { streamText } from "ai";

const openai = createOpenAI({
  baseURL: "https://oai.helicone.ai/v1",
  headers: {
    "Helicone-Auth": `Bearer ${process.env.HELICONE_API_KEY}`,
  },
});

export async function POST(req: Request) {
  const { prompt } = await req.json();
  return streamText({
    model: openai("gpt-4o"),
    prompt,
  }).toUIMessageStreamResponse();
}

LangChain Integration (Python)#

Set Environment Variables:
- HELICONE_API_KEY
- OPENAI_API_KEY
Configure ChatOpenAI:

from langchain_openai import ChatOpenAI
import os

llm = ChatOpenAI(
    model_name="gpt-4o",
    temperature=0,
    base_url="https://oai.helicone.ai/v1",
    api_key=os.environ["OPENAI_API_KEY"],
    default_headers={"Helicone-Auth": f"Bearer {os.environ['HELICONE_API_KEY']}"}
)

Summary#

Update your API base URL to https://oai.helicone.ai/v1 and add the Helicone-Auth header with your API key either in your Vercel AI SDK or LangChain configuration.