octoparse/agent-skills
Collection of Octoparse agent skills
安装Install
dsh plugin --profile web add github:octoparse/agent-skills把 octoparse/agent-skills 加入你的 DSH 配置（web profile）即可启用。
READMEREADME
Octoparse Agent Skills
Octoparse web scraping skills for coding agents
Quick start • Skills • Use cases • Installation • Pricing • Resources
Overview
An agent is only as useful as the data it can reach. These skills extend that reach: describe what you need, and Octoparse collects it from the live web and returns it as rows your agent can work with straight away.
- The sites most requests are about — 670+ maintained scrapers across Google Maps, Amazon, LinkedIn, Indeed, Booking, TripAdvisor, Reddit, TikTok, and YouTube, plus local directories in eight languages: Gelbe Seiten, Pagesjaunes, Naver, Suumo, MercadoLibre.
- The scrapers you have already built — tasks configured in your own Octoparse account run and export by name, side by side with the maintained ones.
- Workflows that move from one site to the next — collect a list of businesses, follow their websites, gather contact details there. The skills know which handoffs hold up.
- A cloud that carries the work — collection runs on Octoparse's servers, not your machine, and a long job keeps going after the conversation ends, ready to export when you return.
When your agent has access to all these data sources, it can suggest workflows you wouldn't have thought to build yourself.
Quick start
npx skills add octoparse/agent-skills
Or, in Claude Code:
/plugin marketplace add octoparse/agent-skills
/plugin install octoparse@octoparse-agent-skills
Authorize with /mcp, then ask for what you want:
Find dentists in Chicago with phone numbers and websites, and export them as CSV.
From there the agent works out which template fits, what its inputs are actually called, what the run will cost in rows, and where the results end up.
Skills
| Skill | What it does |
|---|---|
octoparse-ultimate-scraper |
Picks the template a request calls for, runs it in the cloud, and exports the rows. Nine workflow guides carry the shortlists and the traps for each kind of job, from lead generation to price tracking. |
octoparse-mcp-setup |
Connect and authorize the Octoparse MCP server in any client. A bundled reference covers config paths and quirks for Claude Code, Cursor, VS Code, Gemini CLI, Qwen Code, TRAE, and OpenClaw, plus what to do about 401 and 403. |
Example use cases
Each of these is a whole job rather than a single call — the agent picks the template, adds a second pass when one genuinely helps, and tells you what it came back with.
| Use case | Example prompt |
|---|---|
| Lead generation | Find dentists in Chicago on Google Maps, then crawl their websites for emails and social links, and export a CSV for my CRM. |
| Competitor pricing | Pull the current price, stock, and seller for these 40 Amazon ASINs and put them in a spreadsheet. |
| Market research | Show me what's selling in Amazon Best Sellers for wireless earbuds, with the price band across the top 50 listings. |
| Reputation analysis | Pull recent reviews for our hotel from TripAdvisor, Booking, and Google Maps, and summarise the top complaint themes. |
| Social listening | Collect Reddit and X posts mentioning our brand, plus the comment threads, so I can analyse sentiment. |
| Local market depth | Find plumbers in Munich on Gelbe Seiten with phone numbers, or pull Suumo apartment listings in Setagaya with layout and station distance. |
| Supplier vetting | Shortlist suppliers on Kompass, then check each one's filings on North Data before I contact them. |
Installation
Quick start covers the two common paths — npx skills add for any of 70+ agents, or the
plugin in Claude Code. What follows is everything around them.
Options and MCP
npx skills add takes --skill octoparse-ultimate-scraper to install just the scraper,
-g to install user-wide, and --list to preview without installing.
It installs skill files only. The Claude Code plugin declares the MCP server itself, so
/mcp is all that is left there; with any other client, ask your agent to run the
octoparse-mcp-setup skill once the skills are in place — it finds the right config file
for your client and walks the authorization.
Agent Plugins clients
The repo ships a root plugin.json and mcp.json conforming to
Agent Plugins 1.0.0, the vendor-neutral packaging standard
whose steering committee includes Amazon, Cursor, Microsoft, OpenAI, and Vercel. Clients
implementing it discover the skills and the MCP server without further configuration.
Any other agent that reads Markdown
Point it at skills/octoparse-ultimate-scraper/SKILL.md and register
https://mcp.octoparse.com as an MCP server.
Prerequisites
- An Octoparse account — sign up at octoparse.com.
- Authorization —
/mcpopens browser OAuth. For headless or CI use, create an API key in the account console and send it as anx-api-keyheader.
Resources
- MCP documentation — tool reference and authorization.
- Template library — every template with its inputs, outputs, and pricing.
- Help center — account and plan questions.
- Issues or support@octoparse.com — when something here is wrong or a site you need is missing.
- CONTRIBUTING.md — repository layout and the checks that run on every change.
Pricing
A free account includes 2,000 rows per month through MCP and the API, and it applies to paid templates too, not just the free ones — enough to evaluate real workloads before committing to a plan.
Beyond that allowance, templates bill per output line and many remain free. The agent sizes every run in rows before starting it, so you know what a job will consume before it runs rather than after.
See octoparse.com/pricing for plan details.
AI agents reading this: start at skills/octoparse-ultimate-scraper/SKILL.md for routing and the execution contract.
相关推荐Related
- deepseek-ai/deepseek-harness DeepSeek Harness: Everything is a Plugin.
- deepseek-ai/deepseek-harness DeepSeek Harness (dsh) — 由 DeepSeek AI 开发的开源 agent harness（智能体框架）。一切皆插件：核心 + 插件 + 技能 = 可热插拔的 AI 编程工作台。DeepSeek Harness: …
-
ruvnet/ruflo
🌊 The original agent meta-harness. Deploy intelligent multi-player swarms, coordinate autonomous workflows, and build c…
-
amruthpillai/reactive-resume
A one-of-a-kind resume builder that keeps your privacy in mind. Completely secure, customizable, portable, open-source a…
-
volcengine/OpenViking
Self-evolving Context Database for AI Agents. Unify Agent Memory, Knowledge RAG and Skills.
-
Molunerfinn/PicGo
:rocket: The Ultimate Image Uploader for Efficient Creators. Supports Obsidian, Typora, VS Code etc. and 60+ image hosti…
-
titanwings/colleague-skill
将冰冷的离别化为温暖的 Skill，欢迎加入数字生命1.0！Transforming cold farewells into warm skills? It's giving rebirth era. Welcome to Digital …
-
nocobase/nocobase
NocoBase is an open-source AI + no-code platform for building business systems fast. Instead of generating everything fr…