Go to file
curben 88d6447fe0 Use dos2unix instead of sed
Add sed workaround for matching new line
https://stackoverflow.com/a/1252191
2018-10-11 14:16:51 +10:30
src Filter updated: Thu, 11 Oct 2018 03:27:51 UTC 2018-10-11 03:27:51 +00:00
utils Use dos2unix instead of sed 2018-10-11 14:16:51 +10:30
.gitlab-ci.yml Fix path 2018-10-11 11:12:35 +10:30
LICENSE.md Initial commit 2018-10-09 16:48:46 +10:30
README.md Update formatting and fix typo 2018-10-10 17:24:25 +10:30
urlhaus-filter.txt Filter updated: Thu, 11 Oct 2018 03:27:51 UTC 2018-10-11 03:27:51 +00:00

README.md

URLhaus Malicious URL Blocklist

This uBO-compatible filter list is based on the database dump (CSV) of Abuse.sh URLhaus.

Subscribe

Filter is updated once a day.

Import the following URL into uBO to subcribe:

https://gitlab.com/curben/urlhaus/raw/master/urlhaus-filter.txt

Description

Following URL categories are removed from the database dump:

Database dump is saved as URLhaus.csv, get processed by script.sh and output as urlhaus-filter.txt.

Note

Please report any false positive.

This filter only accepts malware URLs from URLhaus.

Please report malware URL to the upstream maintainer through https://urlhaus.abuse.ch/api/#submit.

This repo is not endorsed by Abuse.sh.

FAQ

  • Can you add this very-bad-url.com to the filter?

  • Why don't you use the URLhaus "Plain-Text URL List"?

    • It doesn't show the status (online/offline) of a URL.
  • Why do you need to clone the repo again in your CI? I thought CI already fetch the repo by default?

    • GitLab Runner clone/fetch the repo using HTTPS method by default (log). This method requires deploy token which is read-only (cannot push).
    • Deploy key has write access but cannot be used with the HTTPS method, hence, the workaround to clone using SSH.
    • See issue #20567 and #20845.