Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
-
Updated
Sep 4, 2024 - Go
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
The unix-way web crawler
Interactive CLI Web Crawler
Fast, highly configurable, cloud native dark web crawler.
A tool to find redirection chains in multiple URLs
Golang Crawling and scraping framework
GoScrapy: Harnessing Go's power for blazingly fast web scraping, inspired by Python's Scrapy framework.
Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.
Via Text Density Simple Web Crawler With Go
豆备 (Doubak) - 豆瓣 (Douban.com) 命令行版备份工具,备份完整页面镜像,Golang实现。
A web crawler built in the Go programming language
Add a description, image, and links to the web-crawler topic page so that developers can more easily learn about it.
To associate your repository with the web-crawler topic, visit your repo's landing page and select "manage topics."