curben
/
urlhaus-filter
mirror of https://gitlab.com/malware-filter/urlhaus-filter
1
0
Fork 0
Code Issues Releases Wiki Activity
1,347 Commits 2 Branches 0 Tags 657 MiB
Shell 90.2%
JavaScript 9.8%
Go to file
curben-bot 8bd1e287c2 Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00
.gitlab Success pipeline 2020-06-06 00:09:59 +00:00
src fix(exclude): add 'cdn-frm-eu.wargaming.net' 2020-05-21 06:50:13 +01:00
utils fix(status-badge): remove dependency on Shields.io 2020-04-01 10:33:08 +01:00
.gitignore chore(gitignore): remove unnecessary regex 2020-03-30 03:34:58 +01:00
.gitlab-ci.yml feat: remove URLhaus.csv 2020-05-14 10:44:25 +01:00
LICENSE.md Initial commit 2018-10-09 16:48:46 +10:30
README.md docs: add daily cron job to installation guide 2020-04-19 14:14:32 +01:00
script.sh fix: remove invalid domains 2020-05-16 00:28:22 +01:00
urlhaus-filter-bind-online.conf Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00
urlhaus-filter-bind.conf Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00
urlhaus-filter-dnsmasq-online.conf Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00
urlhaus-filter-dnsmasq.conf Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00
urlhaus-filter-domains-online.txt Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00
urlhaus-filter-domains.txt Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00
urlhaus-filter-hosts-online.txt Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00
urlhaus-filter-hosts.txt Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00
urlhaus-filter-online.txt Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00
urlhaus-filter-unbound-online.conf Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00
urlhaus-filter-unbound.conf Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00
urlhaus-filter.txt Filter updated: Sun, 07 Jun 2020 12:09:53 UTC 2020-06-07 12:09:53 +00:00

README.md

URLhaus Malicious URL Blocklist

A blocklist of malicious URLs that are being used for malware distribution, based on the Database dump (CSV) of Abuse.ch URLhaus.

There are multiple formats available, refer to the appropriate section according to the program used:

Not sure which format to choose? See Compatibility page in the wiki.

URL-based

Filter is updated twice a day.

Import the following URL into uBO to subscribe:

Mirrors

Lite version (online urls only):
Mirrors

Note: Lite version is ~95% smaller by excluding offline urls. The status of urls is determined by the upstream Abuse.ch. However, the test is not 100% accurate and some malicious urls that are otherwise accessible may be missed. If bandwidth (1.5MB/day) is not a constraint, I recommend the regular version.

PS: While regular version contains roughly 65K filters, uBO can easily handle half a million filters.

Domain-based

This blocklist includes domains and IP addresses.

Mirrors

Lite version (online domains/IPs only):
Mirrors

Hosts-based

This blocklist includes domains only.

Mirrors

Lite version (online domains only):
Mirrors

Dnsmasq

This blocklist includes domains only.

Install

# Create a new folder to store the blocklist
mkdir -p /usr/local/etc/dnsmasq/

# Create a new cron job for daily update
printf '#!/bin/sh\ncurl -L "https://gitlab.com/curben/urlhaus-filter/raw/master/urlhaus-filter-dnsmasq.conf" -o "/usr/local/etc/dnsmasq/urlhaus-filter-dnsmasq.conf"\n' > /etc/cron.daily/urlhaus-filter

# cron job requires execution permission
chmod 755 /etc/cron.daily/urlhaus-filter

# Configure dnsmasq to use the blocklist
printf "\nconf-file=/usr/local/etc/dnsmasq/urlhaus-filter-dnsmasq.conf\n" >> /etc/dnsmasq.conf
Mirrors

Lite version (online domains only):
Mirrors

BIND

This blocklist includes domains only.

Install

# Create a new folder to store the blocklist
mkdir -p /usr/local/etc/bind/

# Create a new cron job for daily update
printf '#!/bin/sh\ncurl -L "https://gitlab.com/curben/urlhaus-filter/raw/master/urlhaus-filter-bind.conf" -o "/usr/local/etc/bind/urlhaus-filter-bind.conf"\n' > /etc/cron.daily/urlhaus-filter

# cron job requires execution permission
chmod 755 /etc/cron.daily/urlhaus-filter

# Configure BIND to use the blocklist
printf '\ninclude "/usr/local/etc/bind/urlhaus-filter-bind.conf";\n' >> /etc/bind/named.conf

Add this to "/etc/bind/null.zone.file" (skip this step if the file already exists):

$TTL    86400   ; one day
@       IN      SOA     ns.nullzone.loc. ns.nullzone.loc. (
               2017102203
                    28800
                     7200
                   864000
                    86400 )
                NS      ns.nullzone.loc.
                A       0.0.0.0
@       IN      A       0.0.0.0
*       IN      A       0.0.0.0

Zone file is derived from here.

Mirrors

Lite version (online domains only):
Mirrors

Unbound

This blocklist includes domains only.

Install

# Create a new folder to store the blocklist
mkdir -p /usr/local/etc/unbound/

# Create a new cron job for daily update
printf '#!/bin/sh\ncurl -L "https://gitlab.com/curben/urlhaus-filter/raw/master/urlhaus-filter-unbound.conf" -o "/usr/local/etc/unbound/urlhaus-filter-unbound.conf"\n' > /etc/cron.daily/urlhaus-filter

# cron job requires execution permission
chmod 755 /etc/cron.daily/urlhaus-filter

# Configure Unbound to use the blocklist
printf '\n  include: "/usr/local/etc/unbound/urlhaus-filter-unbound.conf"\n' >> /etc/unbound/unbound.conf
Mirrors

Lite version (online domains only):
Mirrors

Issues

Report any false positive by creating an issue or merge request

This filter only accepts malware URLs from URLhaus.

Please report new malware URL to the upstream maintainer through https://urlhaus.abuse.ch/api/#submit.

This repo is not endorsed by Abuse.ch.

Cloning

Since the filter is updated frequently, cloning the repo would become slower over time as the revision grows.

Use shallow clone to get the recent revisions only. Getting the last five revisions should be sufficient for a valid MR.

git clone --depth 5 https://gitlab.com/curben/urlhaus-filter.git

License

Creative Commons Zero v1.0 Universal

FAQ

See FAQ.