Commit Graph

35 Commits

Author SHA1 Message Date
MDLeom 7c4b71bbbf
refactor: replace got with fetch 2024-04-07 01:13:34 +00:00
MDLeom dea0eceb2b
fix: disable regex whenever possible 2023-12-31 04:06:41 +00:00
MDLeom 57f8afdc3d
fix: less strict check on pipeline status
it can be "success, "running" or "unknown"
2023-10-02 00:08:34 +00:00
MDLeom 1cbea2cd24
refactor: esm
got is esm only since v12
2023-10-02 00:05:58 +00:00
MDLeom d47888a8a3
fix: check existent of busybox
if dos2unix is not installed
2023-05-20 11:25:09 +00:00
MDLeom 385f6b450e
fix: check installed grep is GNU variant 2023-05-20 11:24:38 +00:00
MDLeom c4421d25d9
fix: dash does not support pipefail 2023-05-20 11:24:04 +00:00
MDLeom ca0cb81902
fix: sed syntax to recognise newline
close #79
2023-04-29 04:08:15 +00:00
MDLeom 7000159da1
fix(exclude): workbyspeech.com
- close #82
- https://urlhaus.abuse.ch/url/2542435/
2023-04-29 03:53:03 +00:00
MDLeom 1dbbe43121
fix(exclude): update s3 endpoints
add new regions
https://docs.aws.amazon.com/general/latest/gr/s3.html#regional-endpoints
2023-04-29 03:22:34 +00:00
MDLeom a34a4a3993
fix(exclude): link.storjshare.io
- close #83
- close !9
2023-04-29 03:21:24 +00:00
MDLeom 21faec52b1
fix(exclude): litter.catbox.moe
close #84
2023-04-29 03:19:34 +00:00
MDLeom 8c60652bba
fix: cloudflare radar dataset is now in csv format
instead of zip
2023-01-16 07:07:34 +00:00
MDLeom 612cfcabdc
style(sed): avoid backslash in insert option
- simpler and more readable
- https://unix.stackexchange.com/a/99351
2022-12-17 00:23:32 +00:00
MDLeom 214cfb7be8
docs(header): switch date format from RFC 5322 to ISO 8601
- universally readable
2022-12-16 08:16:29 +00:00
MDLeom 00a6e3029a
feat: add csv file for Splunk lookup
- https://docs.splunk.com/Documentation/Splunk/9.0.2/Knowledge/Aboutlookupsandfieldactions
- "set -u" is disabled due to CF_API variable
2022-12-16 08:07:38 +00:00
MDLeom df8fe36d39
style: set default options for curl & rm
- curl -L
- rm -rf
2022-11-26 01:36:17 +00:00
MDLeom 9b478347f8
feat: add Cloudflare Radar top 1m domains dataset 2022-11-25 07:13:50 +00:00
MDLeom 9965b32171
feat: fallback to busybox dos2unix 2022-11-03 08:50:36 +00:00
MDLeom 1133e5a053
docs: remove old announcement 2022-11-01 08:14:12 +00:00
MDLeom bc7fee7082
fix: migrate to malware-filter group
- BREAKING CHANGE
- gitlab.com/malware-filter/urlhaus-filter
2022-05-21 03:15:05 +00:00
MDLeom 938aad04ad
fix: migrate to malware-filter group
- BREAKING CHANGE
- gitlab.com/malware-filter/urlhaus-filter
2022-05-21 02:58:20 +00:00
MDLeom d6202d18d8
docs: to be migrated to gitlab.com/malware-filter
- https://about.gitlab.com/blog/2021/11/11/public-project-minute-limits
- https://about.gitlab.com/blog/2022/02/04/ultimate-perks-for-open-source-projects
2022-05-11 07:48:20 +00:00
MDLeom df544d5044
build: check last pipeline status
- using pipeline badge
- https://docs.gitlab.com/ee/ci/pipelines/settings.html#pipeline-status-badge
2022-03-19 05:34:50 +00:00
MDLeom 5bb7f455d2
Revert "fix(build): temporary switch artifact mirror"
This reverts commit d433d9b6cf.
2022-03-14 07:52:11 +00:00
MDLeom d433d9b6cf
fix(build): temporary switch artifact mirror 2022-03-14 06:07:10 +00:00
MDLeom dfba0ce54e
fix(exclude): cfs5.tistory.com
- Closes #61
- https://urlhaus.abuse.ch/url/322758/
- https://en.wikipedia.org/wiki/Tistory
2022-03-14 05:44:57 +00:00
MDLeom 81f07fd627
fix(exclude): mail.myglnc.com
- Closes #57
- https://urlhaus.abuse.ch/url/2011091/
2022-03-14 05:27:07 +00:00
MDLeom 5406998d43
ci: check gitlab status through proper link 2022-01-25 10:08:18 +00:00
MDLeom 4c9c1aba05
ci(ga): trigger cloudflare & netlify from github
if gitlab is down
2022-01-25 10:01:07 +00:00
MDLeom 75cf22e852
build: failover to github if gitlab is unavailable 2022-01-25 09:57:58 +00:00
MDLeom b3eb8324ae
fix: use GNU grep instead of busybox 2022-01-12 06:50:06 +00:00
MDLeom 8cc70ca4ca
fix(exclude): ia801502.us.archive.org
- Closes #53
- https://urlhaus.abuse.ch/url/1893501/
2022-01-10 08:23:11 +00:00
MDLeom 9547ce0eee
docs: requires busybox sh 2022-01-09 07:40:59 +00:00
MDLeom 8c94ddba40
refactor: deploy filters to gitlab pages
- number of commits is becoming unwieldly
- gitlab pages is much faster than downloading from raw git
  * main download link is still curben.gitlab.io/malware-filter/
  * the cons is relying on gitlab ci/pages, previous approach was more portable
2022-01-08 02:09:42 +00:00