LlamaIndex

Use 000 Labs as an OpenAI-like LLM in LlamaIndex.

Use OpenAILike so LlamaIndex accepts any model ID:

Python

# pip install llama-index-llms-openai-like
import os
from llama_index.llms.openai_like import OpenAILike

llm = OpenAILike(
    model="openai/gpt-4o-mini",
    api_base="https://api.000labs.xyz/v1",
    api_key=os.environ.get("000_LABS_API_KEY"),
    is_chat_model=True,
    context_window=128000,
)
print(llm.complete("Hello!"))

LangChain Other OpenAI-compatible clients