Total API Calls

1.2M

Avg Latency

450ms

Compute Cost

$1,240.50

Active Tokens

850M

LLM Models & APIs

Configure Language Models to power your AI Agents and Chat Playground.

Connected

GPT-4 Turbo

Provider: OpenAI

Context Window 128K Tokens
Max Output 4096 Tokens
Response Speed Fast (~800ms)
Cost/1K Tokens $0.01 / $0.03
Connected

Claude 3.5 Sonnet

Provider: Anthropic

Context Window 200K Tokens
Max Output 8192 Tokens
Response Speed Ultra Fast (~400ms)
Cost/1K Tokens $0.003 / $0.015
Connected

Gemini 1.5 Pro

Provider: Google

Context Window 1M Tokens
Max Output 8192 Tokens
Response Speed Fast (~900ms)
Cost/1K Tokens $0.007 / $0.021
Offline (Local)

Llama 3 (70B)

Provider: Meta / Ollama

Context Window 8K Tokens
Architecture Dense
Quantization Q4_K_M
Cost/1K Tokens Free (Local GPU)
Connected

Mistral Large

Provider: Mistral AI (API)

Context Window 32K Tokens
Function Calling Supported Native
Response Speed Very Fast (~600ms)
Cost/1K Tokens $0.008 / $0.024
Connected

DeepSeek Coder V2

Provider: DeepSeek

Context Window 128K Tokens
Specialization Code Generation
Response Speed Fast (~800ms)
Cost/1K Tokens $0.001 / $0.002
Connected

Mixtral 8x7B

Provider: Groq LPU

Context Window 32K Tokens
Architecture MoE
Response Speed Ultra Fast (~150ms)
Cost/1K Tokens $0.0002 / $0.0002
Connected

Command R+

Provider: Cohere (Enterprise)

Context Window 128K Tokens
Specialization RAG & Tool Use
Response Speed Medium (~1.2s)
Cost/1K Tokens $0.003 / $0.015
Active Base

text-embedding-3

Provider: OpenAI (Vector DB)

Context Window 8K Tokens
Dimensions 3072
MTEB Score 64.6
Cost/1K Tokens $0.00013
Connected

Stable Diffusion 3

Provider: Stability AI (Image)

Generation Type Text-to-Image
Max Resolution 1024x1024
Response Speed Fast (~3s)
Cost/Image $0.040
Connected

Whisper V3

Provider: OpenAI (Audio)

Generation Type Speech-to-Text
Languages 99+ Supported
Accuracy 95% (English)
Cost/Minute $0.006
Custom Fine-tuned

CompanyBot V1

Base: Llama-3-8B-Instruct

Training Status 100% Completed
Dataset Used 2.4GB (Sales Docs)
Epochs 3
Endpoints 1 Active Deploy