curben
/
urlhaus-filter
mirror of https://gitlab.com/malware-filter/urlhaus-filter
1
0
Fork 0
Code Issues Releases Wiki Activity
2,599 Commits 2 Branches 0 Tags 657 MiB
Commit Graph

54 Commits

Author SHA1 Message Date
MDLeom 260dfb61cb refactor: move all scripts to src/ 2022-01-07 10:46:43 +00:00
MDLeom 08d129ab9b
chore(ci): enable secret detection 
- https://docs.gitlab.com/ee/user/application_security/secret_detection/
- Closes !8
 2021-06-20 00:20:34 +00:00
MDLeom d1445dcc4c
Revert "fix: add oisd exclusion list" 
This reverts commit 886e3fa22e.
- build failed for unknown reason
 2021-05-07 11:14:37 +00:00
MDLeom 886e3fa22e fix: add oisd exclusion list 
- https://oisd.nl/excludes.php
 2021-05-05 10:03:56 +00:00
MDLeom c971112909 ci: remove curben/malware-filter trigger 
- curben/malware-filter now trigger via its own schedule
 2021-03-31 11:29:55 +00:00
MDLeom f820529576
ci: expire job artifacts in 30 days 2021-03-18 10:20:51 +00:00
MDLeom 9f49be13cc
ci(gitlab): trigger job in curben/curben.gitlab.io 
- https://docs.gitlab.com/ee/ci/multi_project_pipelines.html
 2020-12-12 21:49:13 +00:00
MDLeom 7417d07159
ci: shorter rules:if condition 2020-12-12 21:43:52 +00:00
MDLeom bbf810552a Revert "feat: publish to gitlab pages" 
This reverts commit 6ec6ad12b5.
- Incompatible with current repo
- GitLab Pages will be deployed via https://gitlab.com/curben/malware-filter
 2020-10-08 03:26:22 +00:00
MDLeom 6ec6ad12b5
feat: publish to gitlab pages 
- a workaround for gitlab limit
- ref: #26
 2020-10-08 02:53:27 +00:00
curben 96bf5c84c2
ci: utilize Gitlab's mirroring 
- https://docs.gitlab.com/ee/user/project/repository/repository_mirroring.html
- Commits to protected branches are updated within a minute
- Less one private key to manage
 2020-07-12 08:31:01 +01:00
curben 03ff3a9979
feat: remove URLhaus.csv 
- repo is getting too big
- move URLhaus.csv to job artifact
 2020-05-14 10:44:25 +01:00
curben 54f62ab21f
fix(ci): put 'when' under 'rules' syntax 2020-04-20 11:30:48 +01:00
curben 7f3bdc0bc6
ci: replace 'only/except' with 'rules' syntax 
- https://docs.gitlab.com/ee/ci/yaml/#rules
 2020-04-20 11:17:53 +01:00
curben f51a8ce388
fix(ci): add missing ssh authentication 2020-04-20 10:05:03 +01:00
curben bc370a98ec
ci: move after_script to script 
- after_script is not executed for unknown reason
 2020-04-20 09:56:05 +01:00
curben 7227b68ee7
refactor: drop sed '~' syntax 
- use grep to exclude '#' comment, instead of using sed '~' line traversal
- busybox sed doesn't support '~'
 2020-04-19 08:25:58 +01:00
curben 8638295afb
fix: switch to curl 
- busybox's wget doesn't support redirect
 2020-04-01 11:30:40 +01:00
curben 6f16c016c5
fix: use gnu's grep 
- busybox's grep doesn't support '~'
 2020-04-01 11:02:25 +01:00
curben 3d99d1fe81
fix(status-badge): remove dependency on Shields.io 2020-04-01 10:33:08 +01:00
curben 4d5f8fb87d
fix(status-badge): set git branch 2020-04-01 10:14:30 +01:00
curben a7f38938ff
fix(status-badge): set git identity 2020-04-01 10:06:23 +01:00
curben 14e08a7d46
ci: force exit code 0 with semicolon 
https://unix.fandom.com/wiki/Force_exit_code_0
quote is necessary to escape the semicolon in yml
 2019-10-03 05:52:31 +01:00
curben 41b75d21d4
ci: use commit email 2019-10-03 01:12:21 +01:00
curben 50967c5696
ci: checkout master branch 2019-10-03 00:57:05 +01:00
curben 37bc5a5c38
chore: remove git clone step 2019-10-02 01:46:28 +01:00
curben 6f2888609c
chore: specify branch 2019-10-01 13:08:37 +01:00
curben c76911b2ff
chore: failed_job commit message 2019-10-01 13:00:34 +01:00
curben 0190da7dc4
fix: mirror to github 
- need to re-add ssh key again in after_script
- need to force exit code 0 on 'ssh github'
 2019-10-01 12:57:48 +01:00
curben b1319311e6
feat: mirror to github 2019-10-01 06:45:59 +01:00
curben ccf42db703 chore: fix badge name 2019-06-12 19:46:42 +09:30
curben 12eadbf612 chore: fix building logic 
* use after_script to generate badge
  - after_script executes after all jobs, including failed ones
* deploy_job and failed_job must upload artifacts
* pages job script cannot be empty
* pages job should always run
 2019-06-12 19:44:16 +09:30
curben 4bda908a21 chore(ci): fix artifact directory 2019-06-11 11:53:52 +09:30
curben 8c9f7e3d3f chore: rename badge file 
both success and failed status badge should have the same filename
 2019-06-10 18:08:14 +09:30
curben 472f107d80 chore: Generate badge based on pipeline status 
* The default gitlab pipeline status badge couldn't be used here,
status is only shown for previous pipeline in this repo.
* https://stackoverflow.com/a/49222810
* https://docs.gitlab.com/ee/user/project/pipelines/job_artifacts.html#downloading-the-latest-artifacts
 2019-06-10 17:57:55 +09:30
curben c2a4f3f579 refactor: merge all scripts into script.sh 
each script is too small
 2019-05-29 14:45:08 +09:30
curben 1ab5e6a2cc fix: use GNU's grep instead of the default busybox's 
busybox grep is too slow, its '-F -x' parameters may be buggy
 2019-05-28 12:43:57 +09:30
curben c8977f252e fix: syntax and path in CI config 2019-05-28 10:01:09 +09:30
curben 83d2a65086 refactor: move commit.sh to CI 
the script is not needed for local testing
 2019-05-28 09:51:49 +09:30
curben a7046c77a6 refactor: move script executions from CI config to index.sh 
easier to test locally
 2019-05-27 15:01:57 +09:30
curben 013267e310 perf: grep using urlhaus-top-domains.txt instead of much larger top-1m.txt 2019-05-12 12:48:13 +09:30
curben f700065788 chore(ci): move script.sh to CI config 
to stop the build as soon as current script fails,
especially if wget fails in prerequisites.sh
 2019-05-11 20:27:14 +09:30
curben 5beecca906 feat: include full URL for popular domains 2019-05-11 18:49:25 +09:30
curben 0027cb16c5 chore: run schedules as curben-bot 2018-11-11 21:52:52 +10:30
curben f453b3397d Fix path 2018-10-11 11:12:35 +10:30
curben 67f7c0e1a2 wget is already included in alpine 2018-10-10 18:57:34 +10:30
curben f74cba26b7 Use included zcat 2018-10-10 18:18:36 +10:30
curben e9b7a7edeb Install unzip package 2018-10-10 17:53:19 +10:30
curben 6259ba1f83 Fix incorrect path 2018-10-10 17:27:16 +10:30
curben 5962e0ab28 Reorganise files 2018-10-10 17:14:49 +10:30