A simple trap for web crawlers
-
Updated
Aug 2, 2023 - Rust
A simple trap for web crawlers
**Does not work yet** This system combats scraping by unauthorized AI bots targeting FOSS or documentation sites. It employs a multi-layered defense strategy including real-time detection, tarpitting, honeypots, and behavioral analysis with optional AI/LLM integration for sophisticated threat assessment
**Does not work yet** This project provides a multi-layered defense strategy against scraping by unauthorized AI bots, specifically adapted for deployment on Windows Server using Internet Information Services (IIS). It includes real-time detection, tarpitting, honeypots, and behavioral analysis with optional AI/LLM integration.
JavaScript Email Protection (JEP) is a simple and lightweight way to keep your email safe from spam bots. Instead of leaving your email exposed in plain HTML (where bots can easily grab it), this script dynamically inserts it using JavaScript—making it way harder for scrapers to detect.
A script to protect your web pages and make it significantly harder for others to clone or copy your offers.
Digital media protection and web scraping mitigation for creators at Patreon (or similar services)
Add a description, image, and links to the anti-scraping topic page so that developers can more easily learn about it.
To associate your repository with the anti-scraping topic, visit your repo's landing page and select "manage topics."