From aafe27b8cd7ede44a8439e603210c0ce492fbbf0 Mon Sep 17 00:00:00 2001 From: curben Date: Mon, 27 May 2019 15:22:25 +0930 Subject: [PATCH] docs(faq): offline domains are no longer excluded. https://gitlab.com/curben/urlhaus-filter/commit/bb817d9838d35eda22c5b30018488be0bc19e0db --- FAQ.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/FAQ.md b/FAQ.md index 8185dc4..76b1970 100644 --- a/FAQ.md +++ b/FAQ.md @@ -1,7 +1,7 @@ - How is the filter created? 1. Grab the URLhaus database dump and save it to [URLhaus.csv](https://gitlab.com/curben/urlhaus-filter/blob/master/src/URLhaus.csv). 2. Extract the domains. - 3. Remove offline domains, popular domains ([Umbrella Popularity List](https://s3-us-west-1.amazonaws.com/umbrella-static/index.html)) and more well-known domains (if not listed by Umbrella, see [exclude.txt](https://gitlab.com/curben/urlhaus-filter/blob/master/src/exclude.txt)). + 3. Exclude popular domains ([Umbrella Popularity List](https://s3-us-west-1.amazonaws.com/umbrella-static/index.html)) and some well-known domains (if not listed by Umbrella, see [exclude.txt](https://gitlab.com/curben/urlhaus-filter/blob/master/src/exclude.txt)). 4. Extract the URLs (from step 1) that include popular domains (Umbrella and exclude.txt). 5. Merge the files from step 3 and 4.