vllm-studio-backend

vLLM Studio Backend Architecture

Safety Notice

This listing is imported from skills.sh public index metadata. Review upstream SKILL.md and repository scripts before running.

Copy this and send it to your AI assistant to learn

Install skill "vllm-studio-backend" with this command: npx skills add 0xsero/vllm-studio/0xsero-vllm-studio-vllm-studio-backend

vLLM Studio Backend Architecture

Overview

This skill explains how the backend is wired: controller runtime, OpenAI-compatible proxy, Pi-mono agent loop, LiteLLM gateway, and inference process management.

When To Use

  • Modifying controller routes or run streaming.

  • Debugging OpenAI-compatible endpoint behavior.

  • Updating Pi-mono agent runtime or tool execution.

  • Understanding how inference + LiteLLM fit together.

Quick Start

  • Read references/backend-architecture.md for the component map and data flow.

  • Read references/openai-compat.md for /v1/models and /v1/chat/completions behavior.

  • Read references/backend-commands.md for useful run/debug commands.

Core Guarantees

  • Keep OpenAI-compatible endpoints stable (/v1/models , /v1/chat/completions ).

  • /chat UI uses controller run stream (/chats/:id/turn ) and Pi-mono runtime.

  • Tool execution happens server-side (MCP + AgentFS + plan tools).

References

  • references/backend-architecture.md

  • references/openai-compat.md

  • references/backend-commands.md

Source Transparency

This detail page is rendered from real SKILL.md content. Trust labels are metadata-based hints, not a safety guarantee.

Open in GitHubOpen in ClawHub

Related Skills

Related by shared tags or category signals.

General

vllm-studio

No summary provided by upstream source.

Repository SourceNeeds Review
-8
0xsero
General

image-gen

Generate AI images from text prompts. Triggers on: "生成图片", "画一张", "AI图", "generate image", "配图", "create picture", "draw", "visualize", "generate an image".

Archived SourceRecently Updated
--
0xfango
General

explainer

Create explainer videos with narration and AI-generated visuals. Triggers on: "解说视频", "explainer video", "explain this as a video", "tutorial video", "introduce X (video)", "解释一下XX（视频形式）".

Archived SourceRecently Updated
--
0xfango