Skip to content

Repository files navigation

ShiPlugin — Shi AI: Multi-Model Gateway & Coding Assistant for VS Code

License: MIT VS Code Marketplace GitHub Repository Backend Gateway

ShiPlugin (Shi AI) is an open-source, multi-model AI coding companion and developer toolkit for Visual Studio Code. Powered by the high-performance OmniRoute AI Gateway, ShiPlugin eliminates AI vendor lock-in by uniting 350+ AI providers and 1,200+ models behind a unified, zero-downtime, quota-resilient interface.


📖 About Us

Why ShiPlugin?

Developers today face fragmented AI tooling: switching between separate subscriptions, hitting unexpected rate limits, and lacking the ability to benchmark models side-by-side.

ShiPlugin was engineered to fix this:

  1. One Plugin, Every Model: Seamlessly switch between Claude 3.5 Sonnet, GPT-4o, DeepSeek Chat, Gemini 1.5 Pro, and local LLMs without modifying your workflow.
  2. Smart Fallback & Zero Downtime: If one provider throttles or experiences a rate limit (429), OmniRoute's Last-Known-Good-Path (LKGP) routing instantly and transparently switches to the next best healthy model.
  3. Privacy & Headless Daemon: Runs headless on 127.0.0.1:20128. Your API keys stay in your local workspace .env file — never uploaded to proprietary third-party servers.
  4. Developer-First Ergonomics: Native side-by-side Diff reviews, terminal shell generation, Git Conventional Commits, code reviews, and lightbulb error fixes.

⚡ Feature Highlights

Feature Shortcut Description
⚔️ Model Arena Ctrl+Alt+A / Cmd+Alt+A Benchmark two models side-by-side on the same prompt with latency & token metrics
📝 Inline Diff Editing Ctrl+Alt+I / Cmd+Alt+I Transform selected code in natural language and review side-by-side diffs with 1-click apply
🌿 AI Git Commits Ctrl+Alt+G / Cmd+Alt+G Generate Conventional Commits from git diffs with direct Source Control injection
🛡️ AI Code Review Ctrl+Alt+R / Cmd+Alt+R Run automated security audits, vulnerability scans, and performance analysis
🔍 Codebase Search Ctrl+Alt+S / Cmd+Alt+S Query your workspace architecture and code structure in plain English
💻 Terminal Helper Ctrl+Alt+T / Cmd+Alt+T Convert natural language to safe PowerShell or Bash commands
💡 Quick Fix Diagnostics Ctrl+. Fix compiler, TypeScript, and linter errors with AI in one click
⚡ Inline Ghost Text As you type Real-time code completions via vscode.InlineCompletionItemProvider
🤖 AI Assistant Sidebar Ctrl+Alt+O / Cmd+Alt+O Full GitHub-Flavored Markdown chat with table rendering, code actions, and file attachments

🚀 Quick Start (30 Seconds)

1. Install Extension

Install directly from the VS Code Marketplace or download shi-ai-gateway-1.1.0.vsix from GitHub Releases.

2. Configure Environment (Optional)

Copy .env.example to .env in your workspace root:

# Windows
copy .env.example .env

# macOS / Linux
cp .env.example .env

Add any of your favorite free or paid API keys (Gemini, Groq, DeepSeek, OpenRouter, OpenAI, Anthropic):

OMNIROUTE_MODEL=auto/coding
GEMINI_API_KEY=AIzaSy...
GROQ_API_KEY=gsk_...
DEEPSEEK_API_KEY=sk-...

Note: Even without API keys, ShiPlugin's background daemon will automatically manage local routing and failover!


🏗️ Architecture

┌─────────────────────────────────────────────────────────┐
│              Visual Studio Code (ShiPlugin)             │
│  ┌──────────────┐  ┌──────────────┐  ┌──────────────┐   │
│  │ Chat Sidebar │  │ Inline Diff  │  │ Model Arena  │   │
│  └──────┬───────┘  └──────┬───────┘  └──────┬───────┘   │
└─────────┼─────────────────┼─────────────────┼───────────┘
          │ (OpenAI-Compatible SSE Client)   │
          ▼                                   ▼
┌─────────────────────────────────────────────────────────┐
│     Local OmniRoute AI Gateway (127.0.0.1:20128)        │
│  ┌───────────────────────────────────────────────────┐  │
│  │ Smart Router (auto, auto/coding, auto/fast)       │  │
│  └──────┬───────────────┬──────────────────┬─────────┘  │
└─────────┼───────────────┼──────────────────┼────────────┘
          ▼               ▼                  ▼
    ┌───────────┐   ┌───────────┐      ┌───────────┐
    │ Anthropic │   │  OpenAI   │  ... │ DeepSeek  │
    └───────────┘   └───────────┘      └───────────┘

🤝 Open Source & Contributing

ShiPlugin is completely open source under the MIT License. We welcome all issues, PRs, and suggestions!


📜 License

MIT © 2026 Samay Jain & Contributors. Backend gateway powered by OmniRoute.

About

All-in-one AI coding assistant & gateway for VS Code powered by OmniRoute: 350+ providers, Model Arena, inline diff edits, git commits, code reviews, and background daemon.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages