Commit Graph

1360 Commits

Author SHA1 Message Date
MDLeom d5aa5bcf79
docs: IE TPL guide 2025-03-23 10:19:32 +00:00
MDLeom 48091501bf
feat: include IPs in TPL
tested support IPv4/6
2025-03-23 10:05:08 +00:00
MDLeom ae74714f38
fix(clean_url): extract domain from sophos
closes #92
2025-03-23 03:25:26 +00:00
MDLeom de74a0b373
fix(ids): escape ; on query string 2025-03-22 11:00:33 +00:00
MDLeom f748baa472
fix: clean tmp at start 2025-03-22 10:25:34 +00:00
MDLeom 9708b2c289
fix(clean_url): encode caret 2025-03-22 10:23:24 +00:00
MDLeom 0f4847a03d
refactor: remove unnecessary sort 2025-03-22 07:16:55 +00:00
MDLeom 476b8628e0
fix(ids): skip invalid url 2025-03-22 06:59:49 +00:00
MDLeom b8c5378e1c
style: use strict 2025-03-22 04:19:55 +00:00
MDLeom 23bcdbb2c6
fix: dedup domains and url 2025-03-22 04:19:43 +00:00
MDLeom 693d996267
fix: pipe extracted stdout to parsing 2025-03-19 11:13:16 +00:00
MDLeom 89e8f56702
style: remove unnecessary global flag in sed
not required when matching once per line
2025-03-19 11:10:11 +00:00
MDLeom f4377f1fe6
fix: add address separator to adblock filters
handle url that ends with $
$ is not percent-encoded by browsers
2025-03-19 10:42:23 +00:00
MDLeom 62c754fe23
fix(clean_url): encode ^
this is unrelated to address separator of adblock filter syntax
https://adblockplus.org/filter-cheatsheet#blocking1
which does not need to be escaped
uBO can handle this pattern just fine
||example.com/so%5Emany?ca^r=e^t^$all

query string does not need to percent-encode ^,
only pathname
2025-03-19 10:36:59 +00:00
MDLeom fd8184a806
fix(clean_url): encode all space 2025-03-19 10:36:59 +00:00
MDLeom 5b432df69c
fix(ids): include query string 2025-03-19 10:36:51 +00:00
MDLeom e4002c1110
fix(clean_url): disable terminal
does not expect stdin/out to have escape code
2025-03-18 11:20:47 +00:00
MDLeom d2dc5fbfed
style: standardjs 2025-03-18 10:37:32 +00:00
MDLeom 9d4668bcbd
fix: match top domains to input hostname
instead of url.
to minimise entries such as "bad.com/interactivelogin?continue=https://accounts.google.com"
however, subdomains of top domains will no longer match
2025-03-18 10:32:50 +00:00
MDLeom 58a15ee1df
feat: more robust url parsing
better handle of edge cases
add IPv6 support
increase nodejs requirement to v20 due to URL.canParse()
  https://developer.mozilla.org/en-US/docs/Web/API/URL/canParse_static#browser_compatibility
2025-03-18 10:32:00 +00:00
MDLeom 9b2fe384fd
fix: sid numbering 2025-03-17 11:59:29 +00:00
MDLeom 45783a46b3
perf: rewrite IDS rule creation in javascript
"while do" can be inefficient
previously took >5 minutes is now less than 1 second
2025-03-17 11:51:53 +00:00
MDLeom ec9288267c
fix: match safelink domains
avoid matching path
2025-03-17 10:37:53 +00:00
MDLeom ab5dca49b4
refactor: handle url-without-path & safelinks without "while read"
"while read" can be inefficient
2025-03-16 12:37:56 +00:00
MDLeom 6e359f9a79
fix: remove trailing slash from domain
to replace previous workaround 0578e6c16a
2025-03-16 10:05:02 +00:00
MDLeom ec3dfd77c2
docs: mention PhishTank
revert 352aa34c32
2025-03-16 07:44:01 +00:00
MDLeom 993bb958f5
fix: skip phishtank if download fails 2025-03-16 07:37:17 +00:00
MDLeom 56d67d2a41
Revert "feat: remove phishtank source"
This reverts commit b3f6e90b9a.
https://gitlab.com/malware-filter/phishing-filter/-/issues/40#note_1849507513
2025-03-16 06:56:41 +00:00
MDLeom addedf9c00
ci(gl): add git
required by peaceiris/actions-gh-pages
2025-03-11 07:26:07 +00:00
MDLeom be1b6c05d7
fix: remove credential from domain/IP
fixes #91
2025-03-11 07:23:02 +00:00
MDLeom 06fe677816
ci: install file
remove git
2025-03-08 01:22:48 +00:00
MDLeom e1b051b2fc
fix: remove response header
showing it will stop showing download progress/size
2025-03-08 00:07:04 +00:00
MDLeom a500fca678
fix: use redirected tranco link 2025-03-07 23:55:14 +00:00
MDLeom c5fd7f7d34
fix: output response header to stdout
https://codeahoy.com/general/curl-display-request-response-headers
2025-03-07 23:53:52 +00:00
MDLeom b94d832896
fix: skip tranco if download fails 2025-03-07 23:42:22 +00:00
MDLeom 7e8139510d
style(rpz): generic syntax 2025-02-16 00:44:21 +00:00
MDLeom 78308d7a0b
docs: uBO link 2025-02-16 00:33:23 +00:00
MDLeom 54c487bdcb
docs: pi-hole & brave 2025-02-16 00:32:04 +00:00
MDLeom cd4f298bba
docs: replace mitchellkrogza with IPThreat 2025-02-16 00:27:42 +00:00
MDLeom 677c3b0320
style: table 2025-02-16 00:24:50 +00:00
MDLeom 3529e93ba3
feat: wildcard asterisk 2025-02-16 00:23:22 +00:00
MDLeom 8506f18029
chore: remove unused oisd exclusion 2025-02-15 01:12:03 +00:00
MDLeom f1fa7e450c
build: zstd compress 2025-02-15 01:10:20 +00:00
MDLeom 7f90191c49
feat: add ipthreat.net source 2025-02-08 06:24:03 +00:00
MDLeom d7145f19e1
refactor: parallel rm() 2024-10-27 07:06:04 +00:00
MDLeom 58e50a2f85
build: remove file >=25MiB in cf pages 2024-10-27 07:02:06 +00:00
MDLeom 4cdf3fa532
build: only remove .rules from Cloudflare Pages 2024-10-27 05:46:42 +00:00
MDLeom 293507fead
refactor: extract zip from stream 2024-10-27 05:34:06 +00:00
MDLeom 7fc7d62cc2
chore(deps): bump actions-gh-pages from 3 to 4 2024-10-13 02:37:53 +00:00
MDLeom 614c384390
chore(deps): bump actions/upload-artifact from 2 to 4 2024-10-13 02:37:44 +00:00