scraping

#爬虫框架#一款流行，高效，生态丰富的Python爬虫框架

#网络爬虫#Firecrawl 是一种 API 服务，它爬取URL并将其转换为清洗过的 markdown 或结构化数据

#网络爬虫#AIHawk aims to easy job hunt process by automating the job application process. Utilizing artificial intelligence, it enables users to apply for multiple jobs in a tailored way.

#爬虫框架#一个快速优雅的Golang爬虫框架

#网络爬虫#Python scraper based on AI

#网络爬虫#Crawlee - 一个用于Node.js 开发的网页爬虫和浏览器自动化库

#网络爬虫#Maigret 是一个OSINT用户名检查器。输入目标用户名，即可从各大社交网站采集该用户信息的工具。fork自sherlock开源项目

#网络爬虫#Pythonic HTML Parsing for Humans™

#网络爬虫#webmagic是一个开源的Java垂直爬虫框架，目标是简化爬虫的开发流程，让开发者专注于逻辑功能的开发。webmagic的核心非常简单，但是覆盖爬虫的整个流程，也是很好的学习爬虫开发的材料。

#网络爬虫#Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

#网络爬虫#Tabula is a tool for liberating data tables trapped inside PDF files

#网络爬虫#List of libraries, tools and APIs for web scraping and data processing.

#网络爬虫#A Smart, Automatic, Fast and Lightweight Web Scraper for Python

#网络爬虫#🕷️ An undetectable, powerful, flexible, high-performance Python library to make Web Scraping Easy and Effortless as it should be!

#网络爬虫#Declarative web scraping

#网络爬虫#Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works...

#网络爬虫#Distributed crawler powered by Headless Chrome

#网络爬虫#Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

#网络爬虫#Mechanize is a ruby library that makes automated web interaction easy.

#网络爬虫#数据科学相关的工具、软件以及文章合集