urlhaus-filter/README.md

190 lines
8.1 KiB
Markdown
Raw Normal View History

2018-10-09 06:18:46 +00:00
# URLhaus Malicious URL Blocklist
2018-10-08 10:53:50 +00:00
2020-04-07 06:51:21 +00:00
A blocklist of malicious URLs that are being used for malware distribution, based on the **Database dump (CSV)** of Abuse.ch [URLhaus](https://urlhaus.abuse.ch/).
2018-10-09 06:18:46 +00:00
2020-04-07 06:51:21 +00:00
Please refer to the appropriate section according to the program used:
- uBlock Origin (uBO) / NanoAdblocker -> [URL-based](#url-based) section (recommended)
- Pi-hole -> [Host-based](#host-based) section
- Dnsmasq DNS server -> [Dnsmasq](#dnsmasq) section
## URL-based
2018-10-09 06:18:46 +00:00
Filter is updated twice a day.
2018-10-09 06:18:46 +00:00
Import the following URL into uBO to subscribe:
2018-10-09 06:18:46 +00:00
- https://gitlab.com/curben/urlhaus-filter/raw/master/urlhaus-filter.txt
<details>
<summary>Mirrors</summary>
- https://cdn.statically.io/gl/curben/urlhaus-filter/raw/master/urlhaus-filter.txt
- https://glcdn.githack.com/curben/urlhaus-filter/raw/master/urlhaus-filter.txt
- https://raw.githubusercontent.com/curbengh/urlhaus-filter/master/urlhaus-filter.txt
- https://cdn.statically.io/gh/curbengh/urlhaus-filter/master/urlhaus-filter.txt
- https://gitcdn.xyz/repo/curbengh/urlhaus-filter/master/urlhaus-filter.txt
- https://cdn.jsdelivr.net/gh/curbengh/urlhaus-filter/urlhaus-filter.txt
- https://repo.or.cz/urlhaus-filter.git/blob_plain/refs/heads/master:/urlhaus-filter.txt
2018-10-09 06:18:46 +00:00
</details>
2019-06-13 06:56:45 +00:00
<br />
Lite version (online urls only):
- https://gitlab.com/curben/urlhaus-filter/raw/master/urlhaus-filter-online.txt
<details>
<summary>Mirrors</summary>
2019-06-13 06:56:45 +00:00
- https://cdn.statically.io/gl/curben/urlhaus-filter/raw/master/urlhaus-filter-online.txt
2019-06-13 06:56:45 +00:00
- https://glcdn.githack.com/curben/urlhaus-filter/raw/master/urlhaus-filter-online.txt
- https://raw.githubusercontent.com/curbengh/urlhaus-filter/master/urlhaus-filter-online.txt
- https://cdn.statically.io/gh/curbengh/urlhaus-filter/master/urlhaus-filter-online.txt
- https://gitcdn.xyz/repo/curbengh/urlhaus-filter/master/urlhaus-filter-online.txt
- https://cdn.jsdelivr.net/gh/curbengh/urlhaus-filter/urlhaus-filter-online.txt
- https://repo.or.cz/urlhaus-filter.git/blob_plain/refs/heads/master:/urlhaus-filter-online.txt
2019-06-13 06:56:45 +00:00
</details>
2019-06-13 06:56:45 +00:00
2019-06-13 07:04:21 +00:00
**Note:** Lite version is ~95% smaller by excluding offline urls. The status of urls is determined by the upstream Abuse.ch. However, the test is not 100% accurate and some malicious urls that are otherwise accessible may be missed. If bandwidth (1.5MB/day) is not a constraint, I recommend the regular version.
2019-06-13 06:56:45 +00:00
*PS: While regular version contains roughly 65K filters, uBO can [easily handle](https://github.com/uBlockOrigin/uBlock-issues/issues/338#issuecomment-452843669) half a million filters.*
## Compatibility
This filter is only tested with uBO. [FilterLists](https://filterlists.com/) shows it is compatible with the following software:
2019-10-01 06:58:46 +00:00
- [AdNauseam](https://github.com/dhowe/AdNauseam/)
- [NanoAdblocker](https://github.com/NanoAdblocker/NanoCore)
Host/DNS-based software uses host-based blocklist instead, see below section.
2020-04-07 06:51:21 +00:00
## Host-based
2019-10-01 06:58:46 +00:00
2019-10-01 12:28:51 +00:00
If you're using host-based blockers like one of the following (but not limited to):
2019-10-01 06:58:46 +00:00
- [AdGuard Home](https://github.com/AdguardTeam/AdGuardHome)
2019-10-01 06:58:46 +00:00
- [Blokada](https://github.com/blokadaorg/blokada/)
- [Google Hit Hider](https://www.jeffersonscher.com/gm/google-hit-hider/)
- [hostsmgr](https://www.henrypp.org/product/hostsmgr)
- [Personal Blocklist](https://addons.mozilla.org/firefox/addon/personal-blocklist/)
- [personalDNSfilter](https://zenz-solutions.de/personaldnsfilter)
- [Pi-hole](https://pi-hole.net/)
- [Samsung Knox](https://www.samsungknox.com/)
- [uMatrix](https://github.com/gorhill/uMatrix)
2020-04-07 06:51:21 +00:00
Download blocklist:
2019-06-28 10:21:42 +00:00
2019-10-01 06:58:46 +00:00
- https://gitlab.com/curben/urlhaus-filter/raw/master/urlhaus-filter-hosts.txt
<details>
<summary>Mirrors</summary>
2019-10-01 06:58:46 +00:00
- https://cdn.statically.io/gl/curben/urlhaus-filter/raw/master/urlhaus-filter-hosts.txt
2019-10-01 06:58:46 +00:00
- https://glcdn.githack.com/curben/urlhaus-filter/raw/master/urlhaus-filter-hosts.txt
- https://raw.githubusercontent.com/curbengh/urlhaus-filter/master/urlhaus-filter-hosts.txt
- https://cdn.statically.io/gh/curbengh/urlhaus-filter/master/urlhaus-filter-hosts.txt
- https://gitcdn.xyz/repo/curbengh/urlhaus-filter/master/urlhaus-filter-hosts.txt
- https://cdn.jsdelivr.net/gh/curbengh/urlhaus-filter/urlhaus-filter-hosts.txt
- https://repo.or.cz/urlhaus-filter.git/blob_plain/refs/heads/master:/urlhaus-filter-hosts.txt
2019-10-01 06:58:46 +00:00
</details>
2019-10-01 06:58:46 +00:00
<br />
Lite version (online hosts only):
- https://gitlab.com/curben/urlhaus-filter/raw/master/urlhaus-filter-hosts-online.txt
<details>
<summary>Mirrors</summary>
2019-10-01 06:58:46 +00:00
- https://cdn.statically.io/gl/curben/urlhaus-filter/raw/master/urlhaus-filter-hosts-online.txt
2019-10-01 06:58:46 +00:00
- https://glcdn.githack.com/curben/urlhaus-filter/raw/master/urlhaus-filter-hosts-online.txt
- https://raw.githubusercontent.com/curbengh/urlhaus-filter/master/urlhaus-filter-hosts-online.txt
- https://cdn.statically.io/gh/curbengh/urlhaus-filter/master/urlhaus-filter-hosts-online.txt
- https://gitcdn.xyz/repo/curbengh/urlhaus-filter/master/urlhaus-filter-hosts-online.txt
- https://cdn.jsdelivr.net/gh/curbengh/urlhaus-filter/urlhaus-filter-hosts-online.txt
- https://repo.or.cz/urlhaus-filter.git/blob_plain/refs/heads/master:/urlhaus-filter-hosts-online.txt
2019-06-28 10:21:42 +00:00
</details>
2019-10-01 06:58:46 +00:00
Note that host-based software does not block malware URLs hosted by well-known domains (e.g. amazonaws.com, docs.google.com, dropbox.com).
2020-03-30 03:19:25 +00:00
## Dnsmasq
Dnsmasq-compatible blocklist is also available.
### Install
```
mkdir -p ~/.config/urlhaus-filter/
curl https://gitlab.com/curben/urlhaus-filter/raw/master/urlhaus-filter-dnsmasq.conf -o ~/.config/urlhaus-filter/urlhaus-filter-dnsmasq.conf
2020-03-30 03:19:25 +00:00
printf "\nconf-file=$HOME/.config/urlhaus-filter/urlhaus-filter-dnsmasq.conf\n" >> /etc/dnsmasq.conf
```
### Update
```
curl https://gitlab.com/curben/urlhaus-filter/raw/master/urlhaus-filter-dnsmasq.conf -o ~/.config/urlhaus-filter/urlhaus-filter-dnsmasq.conf
2020-03-30 03:19:25 +00:00
```
<details>
<summary>Mirrors</summary>
- https://cdn.statically.io/gl/curben/urlhaus-filter/raw/master/urlhaus-filter-dnsmasq.conf
- https://glcdn.githack.com/curben/urlhaus-filter/raw/master/urlhaus-filter-dnsmasq.conf
- https://raw.githubusercontent.com/curbengh/urlhaus-filter/master/urlhaus-filter-dnsmasq.conf
- https://cdn.statically.io/gh/curbengh/urlhaus-filter/master/urlhaus-filter-dnsmasq.conf
- https://gitcdn.xyz/repo/curbengh/urlhaus-filter/master/urlhaus-filter-dnsmasq.conf
- https://cdn.jsdelivr.net/gh/curbengh/urlhaus-filter/urlhaus-filter-dnsmasq.conf
- https://repo.or.cz/urlhaus-filter.git/blob_plain/refs/heads/master:/urlhaus-filter-dnsmasq.conf
</details>
<br />
Lite version (online urls only); filename is different, adjust the installation and update instructions appropriately:
- https://gitlab.com/curben/urlhaus-filter/raw/master/urlhaus-filter-dnsmasq-online.conf
<details>
<summary>Mirrors</summary>
- https://cdn.statically.io/gl/curben/urlhaus-filter/raw/master/urlhaus-filter-dnsmasq-online.conf
- https://glcdn.githack.com/curben/urlhaus-filter/raw/master/urlhaus-filter-dnsmasq-online.conf
- https://raw.githubusercontent.com/curbengh/urlhaus-filter/master/urlhaus-filter-dnsmasq-online.conf
- https://cdn.statically.io/gh/curbengh/urlhaus-filter/master/urlhaus-filter-dnsmasq-online.conf
- https://gitcdn.xyz/repo/curbengh/urlhaus-filter/master/urlhaus-filter-dnsmasq-online.conf
- https://cdn.jsdelivr.net/gh/curbengh/urlhaus-filter/urlhaus-filter-dnsmasq-online.conf
- https://repo.or.cz/urlhaus-filter.git/blob_plain/refs/heads/master:/urlhaus-filter-dnsmasq-online.conf
</details>
Note that it is not possible for Dnsmasq to block malicious IP address.
2018-11-12 00:49:13 +00:00
## Issues
2018-10-09 06:18:46 +00:00
Report any false positive by creating an [issue](https://gitlab.com/curben/urlhaus-filter/issues) or [merge request](https://gitlab.com/curben/urlhaus-filter/merge_requests)
2018-10-09 06:18:46 +00:00
This filter **only** accepts malware URLs from [URLhaus](https://urlhaus.abuse.ch/).
2018-10-09 06:18:46 +00:00
2019-04-29 11:49:38 +00:00
Please report new malware URL to the upstream maintainer through https://urlhaus.abuse.ch/api/#submit.
2018-10-09 06:18:46 +00:00
2019-06-13 06:56:45 +00:00
This repo is not endorsed by Abuse.ch.
2018-10-09 06:18:46 +00:00
2019-03-07 00:39:54 +00:00
## Cloning
Since the filter is updated frequently, cloning the repo would become slower over time as the revision grows.
Use shallow clone to get the recent revisions only. Getting the last five revisions should be sufficient for a valid MR.
2019-03-07 00:39:54 +00:00
`git clone --depth 5 https://gitlab.com/curben/urlhaus-filter.git`
2018-11-12 00:49:13 +00:00
## License
[Creative Commons Zero v1.0 Universal](LICENSE.md)
2018-10-09 06:18:46 +00:00
## FAQ
2018-11-12 00:49:13 +00:00
See [wiki](https://gitlab.com/curben/urlhaus-filter/wikis/FAQ).