curben
/
urlhaus-filter
mirror of https://gitlab.com/malware-filter/urlhaus-filter
1
0
Fork 0
Code Issues Releases Wiki Activity

wget and save it into a file 

instead of stdout
This commit is contained in:
curben 2018-10-11 11:23:07 +10:30
parent dc0c654307
commit 073f2b0faf
1 changed files with 6 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
utils/umbrella-top-1m.sh
View File

@ -5,8 +5,12 @@
# https://s3-us-west-1.amazonaws.com/umbrella-static/index.html
# Download the list
wget -O- https://s3-us-west-1.amazonaws.com/umbrella-static/top-1m.csv.zip | \
wget https://s3-us-west-1.amazonaws.com/umbrella-static/top-1m.csv.zip -O top-1m.csv.zip
# Decompress the zip and write output to stdout
zcat -dc | \
zcat -dc top-1m.csv.zip | \
# Parse domains only
cut -f 2 -d ',' > ../src/top-1m.txt
# Remove downloaded zip file
rm top-1m.csv.zip