Skip to content

openstack-ai/openstack

Repository files navigation

OpenStack AI

The Control Plane for AI Requests

A programmable LLM proxy that centralizes authentication, routing, observability, analytics, and billing

DocumentationDashboardWebsite

License: MIT npm version


What is OpenStack AI?

OpenStack is a control plane for AI requests that sits between your application and AI providers (OpenAI, Anthropic, Google, etc.). It provides:

  • 🔐 Authentication & Rate Limiting - Per-user quotas and request controls
  • 🌐 Multi-Provider Routing - Switch between OpenAI, Anthropic, Gemini, and more
  • 📊 Analytics & Observability - Real-time insights and monitoring
  • 💰 Usage-Based Billing - Built-in metering and payment system
  • 🔗 Workflow Automation - Webhooks, integrations, and event triggers

Quick Start

Using the OpenStack SDK

npm install @openstack-ai/sdk
import { Openstack } from "@openstack-ai/sdk";

const openstack = new Openstack(process.env.OPENSTACK_API_KEY);

const response = await openstack.chat.completions.create({
  model: "gpt-4",
  user: "user-123", // Required for auth/quotas
  messages: [{ role: "user", content: "Hello!" }],
});

console.log(response.choices[0].message.content);

Using OpenAI SDK (Drop-in Compatible)

import OpenAI from "openai";

const client = new OpenAI({
  apiKey: process.env.OPENSTACK_API_KEY,
  baseURL: "https://api.openstack.ai/v1",
});

const response = await client.chat.completions.create({
  model: "gpt-4",
  user: "user-123", // Required for auth/quotas
  messages: [{ role: "user", content: "Hello!" }],
});

Using cURL

curl https://api.openstack.ai/v1/chat/completions \
  -H "Authorization: Bearer $OPENSTACK_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-4",
    "user": "user-123",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

Key Features

Built-in Integrations

OpenStack integrates with the tools you already use:

  • Analytics: PostHog, Mixpanel, Snowflake, BigQuery
  • Observability: Langfuse, OpenTelemetry
  • Authentication: Clerk, Auth0, custom JWT
  • Payments: Stripe, wallet system
  • Workflows: Webhooks, n8n, Zapier

Developer Experience

  • OpenAI-Compatible - Works with existing OpenAI code
  • TypeScript-First - Full type safety with our SDK
  • Streaming Support - Real-time response streaming
  • No Vendor Lock-in - Self-hostable (coming soon)

Documentation

📚 docs.openstack.ai - Comprehensive guides and API reference

Dashboard

🎛️ app.openstack.ai - Manage your projects, analytics, and billing

Repository Structure

This is a monorepo managed with Turborepo and pnpm.

Packages

  • @openstack-ai/sdk - Official TypeScript/JavaScript SDK
    • OpenAI-compatible API
    • Full TypeScript support
    • Streaming responses
    • User identity tracking

Apps

  • docs - Documentation site (Mintlify)
    • API reference
    • Guides and tutorials
    • Integration examples

Development

# Install dependencies
pnpm install

# Build all packages
pnpm build

# Build SDK only
pnpm --filter @openstack-ai/sdk build

# Run docs locally
pnpm --filter docs dev

Support

License

MIT License - see LICENSE for details


Built with ❤️ by the OpenStack AI team

WebsiteDocsDashboardGitHub

About

The first platform for launching commercial AI applications and agents.

Resources

License

Contributing

Stars

Watchers

Forks

Packages

No packages published