whitelonng/dsh-plugin-describe-image
DeepSeek Harness plugin: describe_image — give a text-only model vision through an OpenAI-compatible VLM endpoint
安装Install
dsh plugin --profile web add github:whitelonng/dsh-plugin-describe-image把 whitelonng/dsh-plugin-describe-image 加入你的 DSH 配置（web profile）即可启用。
READMEREADME
dsh-plugin-describe-image
English | 中文
DeepSeek Harness 图片理解插件 — a vision-language describe_image tool that gives a text-only model (DeepSeek V4 and friends) the ability to understand images.
A DeepSeek Harness plugin: the model-facing describe_image tool. It loads one image — a local file path, an http(s) URL, or a durable attachment reference — and asks a vision-language model (VLM) at an OpenAI-compatible endpoint (Qwen-VL, GLM-4V, GPT-4o, or a local Ollama endpoint) to describe it. Only the returned text crosses into the conversation; the image itself never enters the session log. Keywords: DeepSeek Harness plugin, describe_image tool, image understanding, image description, multimodal, vision-language model, VLM, text-only model, Qwen-VL, GLM-4V, GPT-4o, Ollama.
Install
dsh plugin --profile web add github:whitelonng/dsh-plugin-describe-image
The desktop app's plugin list accepts the same spec in its install box (github:whitelonng/dsh-plugin-describe-image); the plugin loads after an application restart.
Features
- Three input forms: local path, http(s) URL, or the JSON of an
[image attachment …]note (resolved through the harness attachment service — copy the note verbatim intoimage). - Live configuration card: the Web GUI's Settings → Plugins → "Image understanding" card edits
baseURL,model, and the API key (via the credential seam) with immediate effect — no restart. - Per-call API key resolution: inline
apiKey→ credential seam (apiKeyEnv, defaultVISION_API_KEY) → launch environment. - Security and bounds: redirects refused on every request,
maxBytes/maxOutputTokens/timeoutMsbounds, magic-byte media-type gate, bounded error excerpts, secrets never logged. - Companion harness changes (shipped in the harness repo, not this subtree): the DeepSeek text-only route flattens image blocks into the copyable
[image attachment …]notes, and the host accepts image prompts on text-only routes — together they close the "send an image to a text-only model" loop.
Quick start (in a DeepSeek Harness checkout)
# cordis.yml
- id: describe-image
name: '@deepseek-ai/dsh-tool-describe-image'
config:
baseURL: https://dashscope.aliyuncs.com/compatible-mode/v1
model: qwen-vl-max
apiKey: !!js process.env.VISION_API_KEY
FAQ
What does this plugin do?
It adds the describe_image tool to DeepSeek Harness: the agent (or user) hands the tool an image, the tool asks a configured vision-language model to describe it, and only the description text goes back into the conversation.
Which vision models work?
Any OpenAI-compatible vision endpoint: Qwen-VL (https://dashscope.aliyuncs.com/compatible-mode/v1), GLM-4V, GPT-4o, or a local Ollama endpoint. Set baseURL and model in Settings → Plugins → "Image understanding".
Does the image itself enter the conversation or the session log? No. The image is loaded, checked, and sent only to the vision endpoint; the session log and the model see only the returned description text.
How do I install it?
Run dsh plugin --profile web add github:whitelonng/dsh-plugin-describe-image, or paste the same spec into the desktop app's plugin install box. Restart the application afterwards.
How is the API key configured?
Three layers, in order: an inline apiKey in config, the credential seam (apiKeyEnv, default VISION_API_KEY), then the launch environment. The key is never written into logs.
Is it safe against malicious input? Redirects are refused, media type is gated by magic bytes, sizes and output tokens are bounded, and error excerpts are truncated — a hostile image or endpoint cannot exfiltrate secrets.
Repository layout
packages/vision/
├── README.md # vision capability family
└── tool-describe-image/ # the plugin package (source + tests + docs)
This repository holds the plugin subtree as it lives inside deepseek-harness: package dependencies stay workspace:^, and building, type-checking, and testing happen inside a harness checkout (see INTEGRATION.md). The harness tree is the build environment, not this repo. Keep the two in sync with:
git subtree push --prefix packages/vision dsh-describe-image main # from the harness checkout
Acknowledgments
- LINUX DO — This project is continuously shared and discussed in the LINUX DO community.
License
相关推荐Related
- deepseek-ai/deepseek-harness DeepSeek Harness: Everything is a Plugin.
- deepseek-ai/deepseek-harness DeepSeek Harness (dsh) — 由 DeepSeek AI 开发的开源 agent harness（智能体框架）。一切皆插件：核心 + 插件 + 技能 = 可热插拔的 AI 编程工作台。DeepSeek Harness: …
-
nexu-io/open-design
🎨 Best DeepSeek Harness Design Plugin. The open-source Claude Design alternative. 🖥️ Local-first desktop app. 🖼️ Your…
-
ruvnet/ruflo
🌊 The original agent meta-harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build c…
-
amruthpillai/reactive-resume
A one-of-a-kind resume builder that keeps your privacy in mind. Completely secure, customizable, portable, open-source a…
-
esengine/DeepSeek-Reasonix
DeepSeek-native AI coding agent for your terminal. Engineered around prefix-cache stability — leave it running.
-
volcengine/OpenViking
Self-evolving Context Database for AI Agents. Unify Agent Memory, Knowledge RAG and Skills.
-
Molunerfinn/PicGo
:rocket: The Ultimate Image Uploader for Efficient Creators. Supports Obsidian, Typora, VS Code etc. and 60+ image hosti…