Worlio/banlist
4
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

fix http.md and add a few more

Browse Source
This commit is contained in:
Wirlaburla
2025-05-09 22:13:58 -05:00
parent 67ce992357
commit d52e09a4c1
1 changed files with 6 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
http.md
View File

@@ -8,8 +8,8 @@ Clients blocked by user agent are given a 471 response code.
| `~libwww-perl` | ? | Library often used with scrapers that don't respect robots.txt. | Never | | `~libwww-perl` | ? | Library often used with scrapers that don't respect robots.txt. | Never |
| `~Go-http-client` | ? | Most likely a Matrix server (DDoS). | Never | | `~Go-http-client` | ? | Most likely a Matrix server (DDoS). | Never |
| `~Synapse` | ? | Matrix server AKA DDoSer. | Never | | `~Synapse` | ? | Matrix server AKA DDoSer. | Never |
| `~(Condu(wu)?it|Tuwunnel)` | 2025-05-09 | Matrix server AKA DDoSer. | Never | | `~(Condu(wu)?it\|Tuwunnel)` | 2025-05-09 | Matrix server AKA DDoSer. | Never |
| `~Byte(spider|dance)~` | ? | Chinese. Doesn't respect robots.txt. DDoSer. | Never | | `~Byte(spider\|dance)` | ? | Chinese. Doesn't respect robots.txt. DDoSer. | Never |
| `~AhrefsBot` | ? | Doesn't respect robots.txt. | Never | | `~AhrefsBot` | ? | Doesn't respect robots.txt. | Never |
| `~PetalBot` | ? | Chinese. Doesn't respect robots.txt. | Never | | `~PetalBot` | ? | Chinese. Doesn't respect robots.txt. | Never |
| `~Kinza` | ? | Doesn't respect robots.txt. | Never | | `~Kinza` | ? | Doesn't respect robots.txt. | Never |
@@ -19,16 +19,18 @@ Clients blocked by user agent are given a 471 response code.
| `~serpstatbot` | ? | Webstat bot. Abusive. | Never | | `~serpstatbot` | ? | Webstat bot. Abusive. | Never |
| `~ClaudeBot` | 2025-05-09 | AI Scraper. | Never | | `~ClaudeBot` | 2025-05-09 | AI Scraper. | Never |
| `~AmazonBot` | 2025-05-09 | AI Scraper. | Never | | `~AmazonBot` | 2025-05-09 | AI Scraper. | Never |
| `~GPTBot` | 2025-05-09 | AI Scraper that doesn't respect robots.txt. | Never | | `~GPT` | 2025-05-09 | AI Scraper that doesn't respect robots.txt. | Never |
| `~OpenAI` | 2025-05-09 | AI Scraper. | Never | | `~OpenAI` | 2025-05-09 | AI Scraper. | Never |
| `~DotBot` | 2025-05-09 | Chinese scraper. | Never | | `~DotBot` | 2025-05-09 | Chinese scraper. | Never |
| `~AsyncHttpClient` | 2025-05-09 | Scraper that doesn't respect robots.txt. | Never | | `~AsyncHttpClient` | 2025-05-09 | Scraper that doesn't respect robots.txt. | Never |
| `~Expanse` | 2025-05-09 | Scraper with a really bad user agent. | Never | | `~Expanse` | 2025-05-09 | Scraper with a really bad user agent. | Never |
| `~CheckHost` | 2025-04-02 | Webstat bot. Abusive. | Never |
| `~MJ12` | 2025-04-02 | Scraper. Does not respect robots.txt | Never |
## Referals ## Referals
Clients blocked by referer are given a 472 response code. Clients blocked by referer are given a 472 response code.
| Match | Added | Reason | Expires | | Match | Added | Reason | Expires |
| - | - | - | - | | - | - | - | - |
| `~(soyjak.(st|party))` | ? | Attempted Brigading with CP material. | Never | | `~(soyjak.(st\|party))` | ? | Attempted Brigading with CP material. | Never |
| `~gusfckschulz(.wixsite.com)?` | ? | Attempted Brigading with CP material. | Never | | `~gusfckschulz(.wixsite.com)?` | ? | Attempted Brigading with CP material. | Never |
| `~onionfarms.com` | ? | No reason given. | Never | | `~onionfarms.com` | ? | No reason given. | Never |