jyao-SUSE-power-group/dsh-provider-rate-limit 预览 preview

jyao-SUSE-power-group/dsh-provider-rate-limit

Plugin插件 Native原生 ⭐ 4 MIT Models & Routing模型与路由

dsh-provider-rate-limit

Project Overview项目介绍

This is a native DeepSeek Harness plugin that adds per-provider, per-model rate limiting to LLM traffic. It also supports gateway identity rules for client spoofing on restricted free-tier LLM gateways, including a pre-built one-click preset for OpenCode Zen. You can install it via the DSH plugin manager by running dsh plugin --profile web add github:jyao-SUSE-power-group/dsh-provider-rate-limit, then restart DeepSeek Harness to activate it. It registers itself with the DSH llm service automatically after installation, so you don’t need any extra setup. Manual installation is also supported by cloning the repo to your local DSH plugins folder and running pnpm install --prod.

It implements a token-bucket rate limiter with smooth refill, burst support and idle-time recovery. When the bucket is empty, you can choose between two modes: wait mode that queues requests for up to your configured maximum wait time, or reject mode that immediately returns a synthetic RATE_LIMIT response. It guarantees strict FIFO ordering via a reservation-based design that does not require polling. All configuration options are available via the DSH settings UI, and all changes hot-reload without needing a restart.

It includes a real-time live stats line in the composer dock under the chat input, with SSE-pushed updates that do not require polling. Hovering over the stats line shows a per-route breakdown of provider and model request counts. It also exposes an SSE events endpoint, a JSON stats HTTP API, and a cross-plugin stats service that other DSH plugins can consume to access rate limit data. The entire project is open source under the MIT license, so you can modify it freely to fit your own needs.

这是一个专为DeepSeek Harness开发的原生限流插件,用于对不同供应商、不同模型的LLM请求做粒度限流。它采用带空闲恢复的令牌桶算法,支持突发请求,桶空时支持两种处理模式:排队等待至最大超时放行,或直接拒绝并返回限流响应。同时还支持为受限免费网关做客户端身份伪装,预置一键配置的OpenCode Zen规则。

插件支持严格的FIFO排队规则,通过预留设计保证请求按顺序处理无需轮询。提供全局总开关,关闭时可直接放行所有流量无需重新注册监听器。配置界面支持中英双语,所有配置项都支持热重载,无需重启DSH就能生效。还在聊天输入框下方的停靠栏提供实时统计行,悬浮可查看各路由的详细统计数据。

插件提供SSE推送端点和JSON格式的统计HTTP API,支持其他插件调用跨插件统计服务获取限流数据,也可开放给外部工具使用。路由匹配采用O(1)查找,用预构建Map替代线性扫描提升匹配性能。可通过DSH官方插件管理器一键安装,也支持手动克隆安装,整个项目遵循MIT开源许可协议发布。

Pre-install check安装前体检Compatibility · Security兼容性 · 安全性 1 warning1 项注意
  • Only 4 stars - very few users, little community feedback星标只有 4,几乎没人在用,遇到问题缺少社区反馈
DSH walks through these 9 checksDSH 会逐条核对这 9 项

Compatibility兼容性

  • DSH, Node, OS and profile requirementsDSH 版本 / Node 版本 / 操作系统 / profile 是否满足要求
  • External dependencies and runtimes (Electron / Python / Docker, ...)外部依赖与运行时(Electron / Python / Docker 等)是否齐备
  • Conflicts with installed plugins: command names, skill / tool names, ports, duplicate MCP registration与已装插件是否冲突:命令名、skill / tool 重名、端口占用、重复 MCP 注册

Security安全性

  • Repo matches the facts registered here; archived or abandoned?仓库是否与页面登记一致,是否归档或长期停更
  • Safety of preinstall / install / postinstall and install.sh / setup.ps1preinstall / install / postinstall 与 install.sh、setup.ps1 是否安全
  • curl|bash, download-then-execute, obfuscation, unrelated domains → stop immediatelycurl|bash、下载即执行、混淆代码、无关域名 → 立刻停止
  • Typosquatting or unmaintained packages among the new dependencies新增依赖里有没有 typosquatting 或无人维护的包
  • Requested permissions vs. what the feature actually needs申请了哪些权限、是否超出功能所需(filesystem / network / shell / clipboard)
  • Any sudo / admin requirement, plus uninstall and rollback是否要求 sudo / 管理员权限,以及卸载与回滚方式

Anything uncertain must be marked unknown with a note on how to confirm it. This site's signal screen is a static snapshot, not a security audit.拿不准的必须标「未知」并说明要我怎么确认。本站的信号筛查是静态快照,不能替代安全审计。

Or use CLI install (for developers)或使用命令行安装(适合开发者)

CLI Install命令行安装

dsh plugin --profile web add github:jyao-SUSE-power-group/dsh-provider-rate-limit

把 jyao-SUSE-power-group/dsh-provider-rate-limit 加入你的 DSH 配置(web profile)即可启用。

READMEREADME

dsh-provider-rate-limit

English | 简体中文

Per-provider & per-model rate limiting for DeepSeek Harness LLM traffic, plus gateway identity rules (client spoofing) for restricted free-tier gateways.

适用于 DeepSeek Harness 的按供应商/模型粒度 LLM 限速插件,附带网关身份规则(客户端伪装)能力。

Features

  • Token-bucket rate limiting per (provider, model) route — smooth refill with burst support, idle-time recovery
  • Two modes when the bucket is empty:
    • wait — hold the request up to maxWaitMs, then let it through (transparent queueing)
    • reject — short-circuit immediately with a synthetic RATE_LIMIT response carrying providerRetryAfterMs
  • Strict FIFO — reservation-based design guarantees same-order admission without polling
  • Gateway identity rules — rewrite User-Agent / inject static headers for URLs matching a pattern (e.g. gateways that validate client identity), with a one-click OpenCode Zen preset
  • Master switch — flip enabled off to pass all traffic instantly, no listener re-registration
  • Settings UI card — full configuration from the Harness settings page, zh/en localized
  • Live stats line — compact readout in the composer dock (under the chat input), SSE-pushed in real time (no polling); hover to see per-route provider·model breakdown
  • SSE push endpoint — GET /api/provider-rate-limit.events streams a fresh stats snapshot every time counters change, with a 15 s heartbeat and automatic reconnection
  • Stats HTTP API — GET /api/provider-rate-limit.stats returns aggregate and per-route counters as JSON (used by the dock line; also available for external tooling)
  • Cross-plugin stats service — provider-rate-limit/stats service for in-process consumers (getStats, getAllStats, getAggregateStats, resetStats)
  • O(1) route lookup — pre-built Map for rule matching instead of linear scan
  • Standard ULID — 26-char Crockford base-32 IDs (48-bit big-endian time + 80-bit random)

Install

DSH plugin manager (recommended)

dsh plugin --profile web add github:jyao-SUSE-power-group/dsh-provider-rate-limit

Then restart DeepSeek Harness. The plugin registers itself into the llm service via its cordis patch.

Showing the opening section of the README — the full document lives in the repository以上为 README 开头摘要,完整文档在仓库内 · View the full README on GitHub →在 GitHub 查看完整 README →

← 上一个 Prev dsh-tool-diff 下一个 Next dsh-ppt-studio →