curben
/
phishing-filter
mirror of https://gitlab.com/malware-filter/phishing-filter
1
0
Fork 0
Code Issues Releases Wiki Activity
1,298 Commits 2 Branches 0 Tags 682 MiB
Commit Graph

1298 Commits

Author SHA1 Message Date
MDLeom e02ed129d5
fix(exclude): fonts.gstatic.com 2024-03-09 04:12:33 +00:00
MDLeom 5c7b1f4645
feat(source): add mitchellkrogza/Phishing.Database 
ref #40
revert e68268f506
 2024-03-09 04:06:37 +00:00
Ming Di Leom 6b681bc58f Merge branch 'exclude-s3-fix' into 'main' 
Add Amazon S3 dual-stack endpoints to exclude list

See merge request malware-filter/phishing-filter!8
 2024-03-08 08:11:27 +00:00
Alan Turing ecd739a846 fix(exclude): Add Amazon S3 dual-stack endpoints to exclude list 
and add new regions
https://docs.aws.amazon.com/AmazonS3/latest/userguide/dual-stack-endpoints.html
https://docs.aws.amazon.com/general/latest/gr/s3.html
 2024-03-08 08:11:27 +00:00
MDLeom 1b2312f492
fix: "phishing-subdomains.txt" may be empty 2024-03-08 07:54:33 +00:00
MDLeom 352aa34c32
docs: remove remaining phishtank 2024-03-07 10:16:29 +00:00
MDLeom 93b85b00f9
chore: remove remaining phishunt 
no longer used since #43 #45
 2024-03-07 10:14:08 +00:00
MDLeom b3f6e90b9a
feat: remove phishtank source 
frequent interference from cloudflare captcha
 2024-03-07 10:09:32 +00:00
MDLeom 969e3cb94f
chore(node): require at least Node 18 2023-10-01 09:57:21 +00:00
MDLeom 18187be974
chore(deps): bump got from 11 to 13 2023-10-01 09:57:08 +00:00
MDLeom 6175179162
refactor: esm 
got is esm only since v12
 2023-10-01 09:56:57 +00:00
MDLeom 36a6ab016a
docs: snort/suricate rulesets only available in br/gz-compressed 
47705495f4
 2023-08-22 12:54:10 +00:00
MDLeom 26fae9332d
docs: move download links into a table 
inspired by https://github.com/badmojr/1Hosts
 2023-07-25 11:13:30 +00:00
MDLeom cadabe325d
docs: add repo mirros 2023-06-05 08:04:54 +00:00
MDLeom 07ca1adfd1
refactor: lazy load os-release 2023-05-20 11:23:07 +00:00
MDLeom 667fad0b6f
style: remove debug message 2023-05-20 11:15:29 +00:00
MDLeom 13289d3365
fix: dash does not support pipefail 2023-05-20 10:38:47 +00:00
MDLeom eac902123e
fix: check installed grep is GNU variant 2023-05-20 09:51:12 +00:00
MDLeom eebf51ac47
fix: check existent of busybox 
if dos2unix is not installed
 2023-05-20 09:44:54 +00:00
MDLeom ca23363ef4
fix: reprocess decoded safelink 
- extend 1ea3ce51f5
- also include scope of 0578e6c16a
 2023-05-20 08:20:22 +00:00
MDLeom 0578e6c16a
fix: handle URL of top domains without path 
- ref #62, #43, #44
- 745c81b134, c623542b9a, 8923941376
were not effective previously
 2023-05-19 10:34:04 +00:00
MDLeom a82bec41ed
chore(node): use node 20 
- somehow "node" alias is not recognised
 2023-05-18 12:36:11 +00:00
MDLeom fa839400d2
Revert "ci: downgrade to node 16" 
This reverts commit 19c2385636.
https://blog.cloudflare.com/moderizing-cloudflare-pages-builds-toolbox/
 2023-05-18 12:02:49 +00:00
MDLeom 7dbdc85163
fix: sed syntax to recognise newline 
https://gitlab.com/malware-filter/urlhaus-filter/-/issues/79
 2023-04-29 04:11:14 +00:00
MDLeom 4a99344bee
chore: dual-license under MIT & CC0 
- OSI-approved license (e.g. MIT license) is required
for GitLab Open Source Program
- https://docs.gitlab.com/ee/subscriptions/community_programs.html#gitlab-for-open-source
 2023-04-27 09:26:48 +00:00
MDLeom 745c81b134
fix(exclude): education.gouv.fr 
- close #62
- checked whois record
 2023-04-25 11:24:54 +00:00
MDLeom 4456662716
fix(exclude): *.digitaloceanspaces.com 
- close #61
- close #52
- https://docs.digitalocean.com/products/spaces/details/availability/
 2023-04-25 11:17:05 +00:00
MDLeom 953537642e
fix(exclude): *.safelinks.protection.outlook.com 
- close #58
- enumerated dnsdumpster.com
- related 1ea3ce51f5
 2023-04-25 11:07:03 +00:00
MDLeom 6e68b44c73
fix(exclude): smex-ctp.trendmicro.com 
- closes #59
 2023-04-25 10:51:58 +00:00
MDLeom 99536fa229
fix(exclude): update s3 endpoints 
add new regions
https://docs.aws.amazon.com/general/latest/gr/s3.html#regional-endpoints
 2023-04-25 10:35:23 +00:00
Ming Di Leom 498206c97b Merge branch 'main-patch-0d55' into 'main' 
fix: exclude scaleway S3 object storage

See merge request malware-filter/phishing-filter!5
 2023-04-25 09:54:10 +00:00
__ f45c7e5299 fix: exclude scaleway S3 object storage 
- https://www.scaleway.com/en/docs/storage/object/quickstart/
- https://www.scaleway.com/en/docs/storage/object/api-cli/object-storage-aws-cli/
 2023-04-25 09:54:10 +00:00
MDLeom 8aa4d2334c
fix: cloudflare radar dataset is now in csv format 
instead of zip
 2023-01-16 07:09:35 +00:00
MDLeom 28fdfc930d
ci: compress csv 2022-12-25 05:49:39 +00:00
MDLeom 1542baf603
ci(ga): add Cloudflare Radar 2022-12-25 05:47:21 +00:00
MDLeom c6e6967faa
docs(splunk): list csv columns 2022-12-21 07:35:03 +00:00
MDLeom 85c22653bc
docs: move cron guide to wiki 
- https://gitlab.com/malware-filter/malware-filter/wikis/update-filter
- also include systemd timer
 2022-12-17 04:09:18 +00:00
MDLeom 58d01f85e7
docs: mention vn-badsite-filter 
- https://gitlab.com/malware-filter/vn-badsite-filter
 2022-12-17 00:50:13 +00:00
MDLeom b5048417b0
style(sed): avoid backslash in insert option 
- simpler and more readable
- https://unix.stackexchange.com/a/99351
 2022-12-17 00:19:11 +00:00
MDLeom 97cec9d0e8
feat: add csv file for Splunk lookup 
- https://docs.splunk.com/Documentation/Splunk/9.0.2/Knowledge/Aboutlookupsandfieldactions
 2022-12-17 00:06:59 +00:00
MDLeom 53c62b74c3
docs(header): switch date format from RFC 5322 to ISO 8601 
- universally readable
 2022-12-16 08:18:00 +00:00
MDLeom 0f9696c4f5
fix(exclude): interspar.at 
- https://spar-international.com/country/austria/
- close #25
 2022-12-05 08:11:25 +00:00
MDLeom f5e5e95dd8
fix(exclude): atshop.io 
- close #42
 2022-12-05 08:05:47 +00:00
MDLeom 6303ff306f
fix(exclude): lt27.de 
- https://www.tiekoetter.com/en/services/
- close #41
 2022-12-05 08:03:50 +00:00
MDLeom 48b5a4fce1
fix(exclude): short.upm.es 
- https://en.wikipedia.org/wiki/Technical_University_of_Madrid
- closes #37
 2022-12-05 07:56:47 +00:00
MDLeom 13b9740e66
fix(exclude): netbank.takarekbank.hu 
- https://en.wikipedia.org/wiki/Takar%C3%A9kbank
- closes #47
 2022-12-05 07:53:55 +00:00
MDLeom 1ea3ce51f5
feat: decode O365 safelink 
- https://support.microsoft.com/en-us/office/advanced-outlook-com-security-for-microsoft-365-subscribers-882d2243-eab9-4545-a58a-b36fee4a46e2
 2022-12-04 03:53:09 +00:00
MDLeom 5a4a8bb9bc
refactor: xmlstarlet -> html-xml-utils 2022-12-01 10:00:32 +00:00
MDLeom e653ba90c6
fix: remove extra curl option 2022-11-26 01:31:21 +00:00
MDLeom 4bf534bdbc
feat: add Cloudflare Radar top 1m domains dataset 2022-11-25 07:19:20 +00:00