curben
/
urlhaus-filter
mirror of https://gitlab.com/malware-filter/urlhaus-filter
1
0
Fork 0
Code Issues Releases Wiki Activity

Remove top-1m.txt 

The dataset is not under public domain and may subject to copyright claim by Umbrella/Cisco
This commit is contained in:
curben 2018-10-22 13:40:22 +10:30
parent 28627e268d
commit 1547bb0e96
2 changed files with 3 additions and 916768 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

916768
src/top-1m.txt
View File

File diff suppressed because it is too large Load Diff

3
utils/script.sh
View File

@ -35,3 +35,6 @@ grep -Fx -vf ../src/top-1m.txt | \
grep -Fx -vf ../src/exclude.txt | \
# Append header comment to the filter list
sed '1 i\'"$COMMENT"'' > ../urlhaus-filter.txt
# Remove downloaded dataset
rm ../src/top-1m.txt