A service daemon to run Scrapy spiders
Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO 👉
翻译 - 用于Scrapyd集群管理,Scrapy日志分析和可视化,自动打包,计时器任务,监控和警报以及移动UI的Web应用程序。演示:point_right:
豆瓣电影/豆瓣读书 Scarpy 爬虫
Command line client for Scrapyd server
在scrapyd基础上新增权限验证、爬虫运行信息统计、界面重构、,并增加排序、筛选过滤等多个API
Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉
Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects
A Python wrapper for working with Scrapyd's API.
Basic setup to run ScrapyD + Django and save it in Django Models. You can be up and running in just a few minutes
SpiderAdmin 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具
spider-admin-pro 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具,SpiderAdmin的升级版