Editorial Note: This article was rewritten using Artificial Intelligence (AI) based on original, verified sources. The accompanying images were upscaled with the assistance of AI. Any resemblance of figures in the images to real persons is entirely coincidental. Brands and logos depicted are the property of their respective owners and do not imply official endorsement or affiliation.
Websites are increasingly facing challenges from aggressive AI companies that scrape content, leading to server downtime and reduced accessibility for legitimate users. In response to this growing issue, a new security system named Anubis has been developed and implemented to protect online resources.
Anubis: A Compromise for Website Protection
Anubis employs a Proof-of-Work scheme, drawing inspiration from Hashcash, a proposed method to reduce email spam. This approach ensures that the additional load on individual users is negligible, while significantly increasing the cost and effort for mass scrapers. This makes large-scale data harvesting much more expensive and less efficient for AI companies.
How Anubis Works
The core principle behind Anubis is to present a challenge that requires a small amount of computational effort from the user’s browser. For a human user, this process is quick and often unnoticeable. However, for automated bots attempting to scrape vast amounts of data, this cumulative effort becomes a significant deterrent.
The system is designed as a placeholder solution, allowing administrators more time to develop advanced fingerprinting techniques to identify and block headless browsers, which are commonly used by AI scrapers. These techniques will focus on unique characteristics such as font rendering, aiming to distinguish between legitimate users and automated bots without presenting a Proof-of-Work challenge to human visitors.
Technical Requirements and User Experience
Anubis requires modern JavaScript features to function correctly. Users with browser plugins like JShelter, which disable such features, may need to temporarily disable them for domains protected by Anubis. This is a necessary step to bypass the challenge and access the website content.
The developers acknowledge that a no-JavaScript solution is currently a work in progress. This limitation arises from the evolving landscape of web usage, where AI companies have altered the traditional social contract of website hosting. The goal is to eventually provide a seamless experience for all users, regardless of their JavaScript settings, while maintaining robust protection against scraping.
The Impact of AI Scraping
The aggressive scraping practices of AI companies have a tangible impact on website stability and accessibility. By overwhelming servers with requests, these bots can cause downtime, making essential resources unavailable to the public. Anubis aims to mitigate these negative consequences, ensuring that websites remain operational and accessible for everyone.
Anubis Version and Development
This website is currently running Anubis version v1.27.0. The system is a product of Techaro, developed with a focus on protecting web resources. The mascot design for Anubis was created by CELPHASE, adding a distinct visual identity to the security solution.
For more information, users can refer to the Impressum, Datenschutzerklärung, and Barrierefreiheit sections of the website.
Source: https://www.hu-berlin.de/nachrichten/detail/immatrikulationsfeier-der-humboldt-uni-2026
