curben
/
urlhaus-filter
mirror of https://gitlab.com/malware-filter/urlhaus-filter
1
0
Fork 0
Code Issues Releases Wiki Activity

Clarify on wget -O top-1m.csv.zip

This commit is contained in:
curben 2018-10-13 14:16:15 +10:30
parent 557e531dea
commit 6a4f873744
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@ -38,6 +38,9 @@ This repo is not endorsed by Abuse.sh.
- Why don't you use the URLhaus "Plain-Text URL List"?
+ It doesn't show the status (online/offline) of a URL.
- Why don't you `wget top-1m.csv.zip` and output to stdout?
+ If wget fails, [top-1m.txt](src/top-1m.txt) will be empty. Output as file avoids that.
- Why do you need to clone the repo again in your CI? I thought CI already fetch the repo by default?
+ GitLab Runner clone/fetch the repo using HTTPS method by default ([log](https://gitlab.com/curben/urlhaus/-/jobs/105979394)). This method requires deploy *token* which is *read-only* (cannot push).
+ Deploy *key* has write access but cannot be used with the HTTPS method, hence, the workaround to clone using SSH.