curben
/
urlhaus-filter
mirror of https://gitlab.com/malware-filter/urlhaus-filter
1
0
Fork 0
Code Issues Releases Wiki Activity
75 Commits 2 Branches 0 Tags 657 MiB
Commit Graph

75 Commits

Author SHA1 Message Date
MDLeom d4788f62da
docs: add repo mirros 2023-06-05 08:09:11 +00:00
MDLeom d47888a8a3
fix: check existent of busybox 
if dos2unix is not installed
 2023-05-20 11:25:09 +00:00
MDLeom 385f6b450e
fix: check installed grep is GNU variant 2023-05-20 11:24:38 +00:00
MDLeom c4421d25d9
fix: dash does not support pipefail 2023-05-20 11:24:04 +00:00
MDLeom ded9d5b0f9
chore(node): use node 20 on cf pages 
https://blog.cloudflare.com/moderizing-cloudflare-pages-builds-toolbox/
- "node" nor "lts/*" are not recognised by asdf/node-build
 2023-05-19 08:01:56 +00:00
MDLeom ca0cb81902
fix: sed syntax to recognise newline 
close #79
 2023-04-29 04:08:15 +00:00
MDLeom 7000159da1
fix(exclude): workbyspeech.com 
- close #82
- https://urlhaus.abuse.ch/url/2542435/
 2023-04-29 03:53:03 +00:00
MDLeom 1dbbe43121
fix(exclude): update s3 endpoints 
add new regions
https://docs.aws.amazon.com/general/latest/gr/s3.html#regional-endpoints
 2023-04-29 03:22:34 +00:00
MDLeom a34a4a3993
fix(exclude): link.storjshare.io 
- close #83
- close !9
 2023-04-29 03:21:24 +00:00
MDLeom 21faec52b1
fix(exclude): litter.catbox.moe 
close #84
 2023-04-29 03:19:34 +00:00
MDLeom 7a4f72782d
chore: dual-license under MIT & CC0 
- OSI-approved license (e.g. MIT license) is required
for GitLab Open Source Program
- https://docs.gitlab.com/ee/subscriptions/community_programs.html#gitlab-for-open-source
 2023-04-27 09:30:57 +00:00
MDLeom 8c60652bba
fix: cloudflare radar dataset is now in csv format 
instead of zip
 2023-01-16 07:07:34 +00:00
MDLeom ae92cc6d89
ci: compress csv 2022-12-25 06:01:22 +00:00
MDLeom 05b2410688
ci(ga): add Cloudflare Radar 2022-12-25 05:44:18 +00:00
MDLeom 45438bc24e
docs(splunk): list csv columns 2022-12-21 07:25:56 +00:00
MDLeom f968eb277b
docs: move cron guide to wiki 
- https://gitlab.com/malware-filter/malware-filter/wikis/update-filter
- also include systemd timer
 2022-12-17 04:15:58 +00:00
MDLeom 211e825062
docs: move cron guide to wiki 
- https://gitlab.com/malware-filter/malware-filter/wikis/update-filter
- also include systemd timer
 2022-12-17 03:18:48 +00:00
MDLeom 5936aed858
docs: mention vn-badsite-filter 
- https://gitlab.com/malware-filter/vn-badsite-filter
 2022-12-17 00:49:08 +00:00
MDLeom 612cfcabdc
style(sed): avoid backslash in insert option 
- simpler and more readable
- https://unix.stackexchange.com/a/99351
 2022-12-17 00:23:32 +00:00
MDLeom 214cfb7be8
docs(header): switch date format from RFC 5322 to ISO 8601 
- universally readable
 2022-12-16 08:16:29 +00:00
MDLeom 00a6e3029a
feat: add csv file for Splunk lookup 
- https://docs.splunk.com/Documentation/Splunk/9.0.2/Knowledge/Aboutlookupsandfieldactions
- "set -u" is disabled due to CF_API variable
 2022-12-16 08:07:38 +00:00
MDLeom df8fe36d39
style: set default options for curl & rm 
- curl -L
- rm -rf
 2022-11-26 01:36:17 +00:00
MDLeom 9b478347f8
feat: add Cloudflare Radar top 1m domains dataset 2022-11-25 07:13:50 +00:00
MDLeom 9965b32171
feat: fallback to busybox dos2unix 2022-11-03 08:50:36 +00:00
MDLeom ff3773ab9f
style: md syntax 2022-11-02 10:36:20 +00:00
MDLeom 8585e66eb3
docs: toc & mention compressed version 2022-11-01 08:18:54 +00:00
MDLeom 1133e5a053
docs: remove old announcement 2022-11-01 08:14:12 +00:00
MDLeom 37016eb861
ci: downgrade to node 16 
- lts is now 18
- cf pages still does not support v18 yet
 2022-11-01 06:57:28 +00:00
MDLeom 478ebc3430
ci(gl): expires job artifacts 
- https://docs.gitlab.com/ee/user/usage_quotas.html
 2022-08-09 00:11:13 +00:00
MDLeom bc7fee7082
fix: migrate to malware-filter group 
- BREAKING CHANGE
- gitlab.com/malware-filter/urlhaus-filter
 2022-05-21 03:15:05 +00:00
MDLeom 938aad04ad
fix: migrate to malware-filter group 
- BREAKING CHANGE
- gitlab.com/malware-filter/urlhaus-filter
 2022-05-21 02:58:20 +00:00
MDLeom d6202d18d8
docs: to be migrated to gitlab.com/malware-filter 
- https://about.gitlab.com/blog/2021/11/11/public-project-minute-limits
- https://about.gitlab.com/blog/2022/02/04/ultimate-perks-for-open-source-projects
 2022-05-11 07:48:20 +00:00
MDLeom a150aa73d3
docs: move wiki to malware-filter 
- https://gitlab.com/curben/malware-filter/wikis/compatibility
 2022-03-30 06:59:21 +00:00
MDLeom df544d5044
build: check last pipeline status 
- using pipeline badge
- https://docs.gitlab.com/ee/ci/pipelines/settings.html#pipeline-status-badge
 2022-03-19 05:34:50 +00:00
MDLeom 2aac4dd1c6
ci(ga): remove deps install from netlify step 2022-03-14 21:07:25 +00:00
MDLeom 5bb7f455d2
Revert "fix(build): temporary switch artifact mirror" 
This reverts commit d433d9b6cf.
 2022-03-14 07:52:11 +00:00
MDLeom 270b216f66
docs: remove netlify mirror 2022-03-14 06:44:48 +00:00
MDLeom 3e8f65d800
ci: cloudflare job does not need artifact 2022-03-14 06:24:01 +00:00
MDLeom 4263fea593
ci: netlify job does not need to save artifact 2022-03-14 06:19:20 +00:00
MDLeom c04a504d5d
ci(ga): reuse build artifact in netlify step 2022-03-14 06:13:14 +00:00
MDLeom d433d9b6cf
fix(build): temporary switch artifact mirror 2022-03-14 06:07:10 +00:00
MDLeom 422b9751d5
ci: add dependency to cloudflare & netlify jobs 2022-03-14 05:58:01 +00:00
MDLeom dfba0ce54e
fix(exclude): cfs5.tistory.com 
- Closes #61
- https://urlhaus.abuse.ch/url/322758/
- https://en.wikipedia.org/wiki/Tistory
 2022-03-14 05:44:57 +00:00
MDLeom 81f07fd627
fix(exclude): mail.myglnc.com 
- Closes #57
- https://urlhaus.abuse.ch/url/2011091/
 2022-03-14 05:27:07 +00:00
MDLeom 2af218ef82
ci: add dependency to gitlab pages job 2022-03-14 05:18:29 +00:00
MDLeom 1866f8bb2a
ci: npm cache 2022-01-26 04:18:12 +00:00
MDLeom 5406998d43
ci: check gitlab status through proper link 2022-01-25 10:08:18 +00:00
MDLeom f1a81208d2
ci: check gitlab status 2022-01-25 10:06:39 +00:00
MDLeom 4c9c1aba05
ci(ga): trigger cloudflare & netlify from github 
if gitlab is down
 2022-01-25 10:01:07 +00:00
MDLeom 75cf22e852
build: failover to github if gitlab is unavailable 2022-01-25 09:57:58 +00:00