Commit Graph

709 Commits

Author SHA1 Message Date
decoy-walrus 15e1ba1322
Hack in support for the new twitter video format (#381)
This change adds ".m4s" and ".mp4" to the regex that modifies m3u8 playlist files proxied from twitter, and adds ".m4s" to the list of extensions proxied through nitter. The net effect is the new video format that twitter is using now should be supported.
2021-05-08 18:05:31 +02:00
Zed 4a38b270af Don't release empty tokens 2021-01-25 11:07:29 +01:00
Zed 67142bea6a Don't discard tokens on length errors 2021-01-25 11:04:36 +01:00
Zed 67e15bb492 Temporary (?) fix for false rate limits 2021-01-18 07:57:39 +01:00
Zed 51b1567af6 Improve token pool to prevent rate limits 2021-01-13 14:32:26 +01:00
Zed e1b3e9db76 Add proper http support
Fixes #223
2021-01-08 02:36:06 +01:00
Zed ecc8bc5a95 Slightly lower main tweet font size 2021-01-08 01:28:27 +01:00
Zed ed7ecf7c8d Preload profile/tweet images, banners, and icons 2021-01-08 00:50:10 +01:00
Zed 768642a2cc Improve link preview headers 2021-01-07 23:58:29 +01:00
Zed 4e1d213488 Show error page when rate limited 2021-01-07 22:31:29 +01:00
Zed 2128b280b4 Minor cleanup 2021-01-07 22:04:19 +01:00
Zed 384b0a2033 Fix profile caching logic to ignore empty profiles 2021-01-07 22:04:01 +01:00
Zed cd4840363c Split IDs into buckets to reduce Redis mem usage 2021-01-03 03:51:15 +01:00
Zed b3b0654507 Use preloads and defer to speed up page loads 2021-01-03 01:39:23 +01:00
Zed 18988a6a55 Slightly lower Nitter navbar font size 2021-01-03 01:39:23 +01:00
Zed 93ec4b1e39 Fix max gif height 2021-01-02 20:11:02 +01:00
Zed ced729c6d5 Limit height of card images 2021-01-02 19:27:49 +01:00
Zed c327f4cc06 Downgrade Frosty again to prevent OOM
It works, let's not fuck with it any more than necessary.
2021-01-02 19:27:11 +01:00
Zed 680cc429d6 Update frosty, add migration 2020-11-15 20:18:13 +01:00
Zed 7ad6f581c2 Simpler gif fix 2020-11-15 18:11:22 +01:00
Zed 8912985beb Update css version query 2020-11-15 18:04:52 +01:00
Zed 0d4048a62e Fix inline gif regression 2020-11-15 18:03:51 +01:00
Zed 320cb47bce Switch to supersnappy, update frosty 2020-11-15 01:21:56 +01:00
Zed 3b5b4b7682 Improve tweet url and hashtag parsing 2020-11-15 01:03:04 +01:00
Zed 50218bcc4d Revert "Improve tweet url and hashtag parsing"
This reverts commit d67ed26817.
2020-11-14 23:37:07 +01:00
SolitudeSF d67ed26817 Improve tweet url and hashtag parsing
Dry

Fixes
2020-11-14 23:28:22 +01:00
SolitudeSF cad75845db Fix compilation error with nim 1.4.0 2020-11-10 15:55:41 +01:00
SolitudeSF 48aa8d8e48 Replace spaces in list name 2020-11-10 15:54:08 +01:00
Zed 1d0f95b79d Fix card video preview 2020-11-09 21:24:34 +01:00
Zed af634231b9 Support card previews 2020-11-09 21:20:33 +01:00
bopol ed91133b21 Change order of quoted replies 2020-11-08 13:32:18 +01:00
Zed 104dc95bd7 Fix quote video size 2020-11-08 04:30:38 +01:00
Zed 0ef85031a7 Add version query to css to force updates 2020-11-08 03:15:51 +01:00
Zed 4610ec6122 Increase user search avatar resolution 2020-11-08 03:09:40 +01:00
Zed 0f72b64ce2 Increase tweet avatar resolution 2020-11-08 02:56:06 +01:00
Zed b389723bf5 Reduce main tweet font size on mobile 2020-11-08 02:50:03 +01:00
Zed b6a49fc4cb Support quoted replies stat, update font 2020-11-08 02:21:58 +01:00
Zed 82fe5d8b78 Make bidirectional support a preference
Fixes #270
2020-11-08 00:41:12 +01:00
Zed 13bdd6497b Support bidirectional quote text 2020-11-08 00:06:37 +01:00
Zed d358912790 Sanitize XML to remove invalid characters
Fixes #268
2020-11-07 23:53:49 +01:00
Zed 375cb1a243 Fix removal of logging on release 2020-11-07 23:16:47 +01:00
Zed 9f5042dbd3 Add missing entry type to entryId parser 2020-11-07 23:10:29 +01:00
Zed 3107ab0ab8 Fix content-length crash 2020-11-07 23:02:27 +01:00
Zed 2d7e12fcb8 Fix parsing censored tweets 2020-11-07 22:48:49 +01:00
Zed 509e1dc5e8 Remove leftover from wip stuff 2020-11-07 22:48:30 +01:00
Zed bd97cea709 Update dependencies 2020-11-07 21:46:03 +01:00
Zed 3bd0488c66 Add http pool to reduce connection overhead 2020-11-07 21:31:03 +01:00
Zed 06f7a8d95f Fix parsing "Show more" without digits 2020-10-01 22:08:25 +02:00
110Percent 2c6cabb4ab Add image card for better third-party embedding 2020-08-21 16:07:55 +02:00
jtagcat 75fea828cb Change the default invidio.us (EoL) to snopyta's. 2020-08-21 15:49:16 +02:00
Kadin Buckton e177759722 Fix firefox image sizes 2020-07-18 23:28:13 +02:00
Zed 514d1b3121 Add temporary token fail safe 2020-07-09 09:18:36 +02:00
Zed 38d4ba6298 Add liberapay logo 2020-07-04 13:20:54 +02:00
Zed 613e460b9e Add activate endpoint 2020-06-24 15:03:18 +02:00
Zed 4c1270b377 Use old API endpoint to fetch tokens 2020-06-24 15:02:34 +02:00
Zed bde3c3662d Silence some warnings 2020-06-22 03:50:16 +02:00
Zed db100bbf17 Temporary fix to prevent early token expiry 2020-06-19 09:45:24 +02:00
Zed 91f42c4c94 Nevermind. 2020-06-17 20:55:01 +02:00
Zed 51c7af082d We no longer know whether profiles are suspended 2020-06-17 17:19:08 +02:00
Zed bc0ccb483a New query rules, big multi-user query optimization 2020-06-17 14:16:48 +02:00
Zed 2127af71b4 Partial fix for wrong multi-user twitter link 2020-06-17 14:15:13 +02:00
Zed 33f0ab0ba5 Always show retweets unless excluded in search 2020-06-17 14:12:38 +02:00
Zed 0e58c36bae Change user endpoint 2020-06-17 00:22:11 +02:00
Zed 77da2e32c6 Use old api to optimize photo rails 2020-06-17 00:20:34 +02:00
Zed 7e40af5611 Revert token change 2020-06-16 00:48:44 +02:00
Zed 6167e7dc49 Refactor fetch helper, fix list pagination 2020-06-15 16:44:14 +02:00
Zed 7643293f6b Fix tombstone parsing
Apparently they just got rid of the "epitaph", oh well
2020-06-12 08:01:31 +02:00
Zed bd386b3acf Proper support for gif avatars
Fixes #160
2020-06-10 18:34:56 +02:00
Zed e4cbbf2fd5 Show retweet and reply usernames in rss titles
Fixes #185
2020-06-10 17:52:21 +02:00
Zed 07492b7b39 Escape rss titles
Fixes #168
2020-06-10 17:17:17 +02:00
Zed 1811a23265 Parse alternative video title 2020-06-10 17:09:38 +02:00
Zed 179b3bc496 Parse video profile 2020-06-10 17:06:05 +02:00
Zed 4f6b8bad9e Lower avatar resolutions 2020-06-10 17:05:44 +02:00
Zed 754f88a448 Show avatars in quotes, improve css 2020-06-10 17:04:48 +02:00
Zed 0c9c37e886 Support even more obscure card types 2020-06-10 16:19:01 +02:00
Zed 09b85464bd Reenable logging for non-release builds 2020-06-09 20:29:05 +02:00
Zed 61d27efd69 Optimize profile caching strategy 2020-06-09 18:19:20 +02:00
Zed ba9ba3a55e Add cookie note so we don't break the law 2020-06-09 17:01:30 +02:00
Zed db45433ec4 Optimize usage of cookie preferences 2020-06-09 16:45:21 +02:00
Zed 310c5e936d Optional base64 support for proxy urls 2020-06-09 15:22:58 +02:00
Zed 1b9fa40237 Silence Jester's query warning 2020-06-07 09:28:56 +02:00
Zed 908da72ba9 Use frosty instead of msgpack, compress everything 2020-06-07 08:50:40 +02:00
Zed a8553db66e Use small video previews 2020-06-07 08:40:17 +02:00
Zed 40ef23956a Catch connection closed errors 2020-06-07 08:23:05 +02:00
Zed 9c8c2cbe88 Use small image version for preview to save memory 2020-06-07 07:57:32 +02:00
Zed 34dd02df1b Add photo rail test 2020-06-07 07:57:15 +02:00
Zed 47c87f7068 Strip https://pbs.twimg.com from image urls 2020-06-07 07:55:57 +02:00
Zed ea7222bc86 Optimize photo rail parser 2020-06-07 07:54:20 +02:00
Zed be74cec48a Refactor instruction parsing 2020-06-07 07:53:40 +02:00
Zed 67313ac12a Use regex for hashtags instead 2020-06-06 10:28:55 +02:00
Zed 181ef3bca7 Use snappy for rss compression, refactor 2020-06-06 09:27:25 +02:00
Zed 68a5ac20b6 Proxy media instead of using file cache 2020-06-06 04:39:22 +02:00
Zed 1dcb191903 Improve quote css 2020-06-05 16:58:06 +02:00
Zed 2fe0d8daae Fix wrong error message when rss timeline is empty 2020-06-05 16:49:30 +02:00
Zed 1fecd63d78 Skip photo rails for rss 2020-06-05 16:49:10 +02:00
Zed 2a654ea5cd Fix missing search params in rss cache 2020-06-05 16:29:22 +02:00
Zed 1a9e5a6c72 Fix user search pagination 2020-06-05 00:11:05 +02:00
Zed 3ecda47c73 Improve hashtag regex
Fixes #178
2020-06-04 23:14:31 +02:00
Zed 240a6f9fd3 Fix poll percentages when 0 votes
Fixes #177
2020-06-04 22:56:14 +02:00
Zed 42421e58de Fix tweet ID parsing bug on 32-bit 2020-06-04 05:03:25 +02:00
Zed f0db3a8bc2 Don't cache empty profile 2020-06-03 07:49:32 +02:00
Zed 22b0bce1ea One more time 2020-06-03 02:42:26 +02:00
Zed 85d972dc36 Add it back fully 2020-06-03 02:41:37 +02:00
Zed a7e969e397 Add back promo_video_website
Doesn't exist when you search for it, but apparently it does exist.
2020-06-03 02:38:04 +02:00
Zed 4d650fd33e Support more cards, even the undocumented ones 2020-06-03 02:33:34 +02:00
Zed b4fe3d1f6a Prevent unnecessary profile cache 2020-06-03 00:03:41 +02:00
Zed d01f62c5ae Clean up cache code 2020-06-02 23:06:14 +02:00
Zed 9ad458ae25 Fix Twitter link for searches 2020-06-02 22:31:46 +02:00
Zed 548cb62ff2 Fix very strange cache bug
This happened once and I have no idea why, but it shouldn't cause a crash.
2020-06-02 22:15:04 +02:00
Zed 77f03425ef Preserve original UTC timestamp 2020-06-02 22:02:10 +02:00
Zed 3dc85639f4 Fix crash on token fetch failure 2020-06-02 20:37:55 +02:00
Zed 7acea6b9e0 Add user agent for media requests, improve error 2020-06-02 20:27:43 +02:00
Zed 80d963fab6 Fix crash when disk is full 2020-06-02 19:58:24 +02:00
Zed 2930293833 Fix relative timestamps 2020-06-02 19:30:31 +02:00
Zed e453d9dd59 Add yet another card type 2020-06-02 18:05:54 +02:00
Zed fb591e43b8 Switch to packedjson to try lowering memory usage 2020-06-02 18:05:54 +02:00
Zed 2fa76db099 Simplify error parser 2020-06-02 18:05:54 +02:00
Zed 2642e5efe4 More aggressive token strategy to combat bursts 2020-06-02 18:05:54 +02:00
Zed baa28ea8bc Prevent crash when token missing 2020-06-02 18:05:54 +02:00
Zed 87d1e49f1a Remove unnecessary table 2020-06-02 18:05:54 +02:00
Zed 12fb55745d Quit with return code to indicate error 2020-06-02 18:05:54 +02:00
Zed e0943eeec8 Minor optimizations 2020-06-02 18:05:54 +02:00
Zed 1fb78f8047 Minor token changes 2020-06-02 18:05:54 +02:00
Zed dc79f736d0 Minor quote gif css improvement 2020-06-02 18:05:54 +02:00
Zed 01faa784ea Add Redis connection error message 2020-06-02 18:05:54 +02:00
Zed 4a43209386 Update readme 2020-06-02 18:05:54 +02:00
Zed 43e87f5174 Expand "bounced" tombstone match 2020-06-02 18:05:54 +02:00
Zed 10277bb58d More card kinds 2020-06-02 18:05:54 +02:00
Zed 74534e8fef Use old user endpoint to avoid graphql rate limits 2020-06-02 18:05:54 +02:00
Zed 39863703b3 Error stuff 2020-06-02 18:05:54 +02:00
Zed 0859d8c2d9 Add missing card kinds (specific parsers pending) 2020-06-02 18:05:54 +02:00
Zed a2c0e1a21d Add missing tombstones 2020-06-02 18:05:54 +02:00
Zed 21fdbb88ec Fix RSS retweet rendering 2020-06-02 18:05:54 +02:00
Zed 1cb57401b6 Ignore trailing slashes for list routes 2020-06-02 18:05:54 +02:00
Zed 2a3bcaa9aa Fix retweet deduplication 2020-06-02 18:05:54 +02:00
Zed ec86a55b48 Fix timestamp parsing in non-UTC timezones
Twitter always has +0000 in the timestamp despite being relative
to your IP geolocation. Shame on you, Twitter.
2020-06-02 18:05:54 +02:00
Zed 177e119441 Hotfix missing card type 2020-06-02 18:05:54 +02:00
Zed e1fff6985b New configs 2020-06-02 18:05:54 +02:00
Zed 81d6d1ac7f Misc. changes 2020-06-02 18:05:54 +02:00
Zed 4c928fa8b0 Routing updates 2020-06-02 18:05:54 +02:00
Zed 2950c0de35 html and css updates 2020-06-02 18:05:54 +02:00
Zed 762d00b21d In with the new 2020-06-02 18:05:54 +02:00
Zed 4167ce458b Out with the old 2020-06-02 18:05:54 +02:00
Zed 5eec0bde3d Misc. fixes and refactorings 2020-06-02 18:05:54 +02:00
Zed 62f8edf027 Fix replies again 2020-05-20 07:06:45 +02:00
Zed 312ff78628 Store preferences in cookies, add config defaults 2020-05-08 02:48:47 +02:00
Zed 517d9144f6 Fix regression excluding replies from search 2020-05-02 19:44:10 +02:00
Zed 1bd48ea8ca Fix timeline double requests due to templates
This one is a bit embarrassing..
2020-05-02 19:23:47 +02:00
Zed 9197c686d3 Fix multi-timeline infinite scroll, minor refactor 2020-05-02 19:22:43 +02:00
Zed dc3c37b854 Fix renderReplies, take 2 2020-05-01 12:29:01 +02:00
Zed 3dec3fba38 Fix rare renderReplies crash 2020-04-30 14:34:03 +02:00
Zed a3cc0e181a Support multiline page title
Fixes #123
2020-04-29 18:17:56 +02:00
Zed c6215876fa Implement proper infinite scroll for replies
Fixes #125
2020-04-29 18:10:17 +02:00
Zed 92b3ba057d Fix trailing slash routing error
Fixes #146
2020-04-29 15:09:51 +02:00
Zed feb939d918 Minor multi-user timeline optimization 2020-04-29 15:06:15 +02:00
Zed 326776fde7 Fix broken reply exclude
Fixes #144
2020-04-29 15:06:01 +02:00
Zed 8a6978cf74 Detect suspended accounts 2020-04-15 00:28:45 +02:00
Zed 240ce15651 Revert og:title for tweets 2020-03-29 23:20:00 +02:00
Zed 8a11b5a167 Add tweet page titles
Fixes #124
2020-03-29 09:15:05 +02:00
Zed ed79ed25a7 Add Instagram replacement preference
Fixes #133
2020-03-29 09:03:06 +02:00
Zed a7ffb6d2f2 Add "R:" label to RSS replies
Fixes #139
2020-03-29 08:06:20 +02:00
Zed 9f9fccb70b Display "GIF" below gifs
Fixes #141
2020-03-29 08:05:09 +02:00
Zed b3d1fb4491 Use max-width css instead of width html attribute
Fixes #111
2020-03-09 02:02:16 +01:00
Zed 0582e2ea95 Fix displaying urls in location fields 2020-03-09 01:03:24 +01:00
Zed df943c09d9 Fix converted youtube channel links 2020-03-09 00:47:00 +01:00
Zed 9b4b70e2e4 Fix card links 2020-03-09 00:33:52 +01:00
Zed 8c50692299 Add periodic cache cleaner prevent slowdowns 2020-03-09 00:17:42 +01:00
Zed 211cd5964a Catch more httpclient exceptions 2020-03-09 00:17:13 +01:00
Zed 5fc458638d Store profile usernames in lowercase for speedup 2020-03-09 00:12:42 +01:00
Zed a89376008a Bypass A/B testing by restricting user agents 2020-01-22 15:22:06 +01:00
Zed b87cd39bce Remove failed guest ID experiment 2020-01-22 15:21:26 +01:00
Zed b03faccd45 Turn regex patterns into consts 2020-01-22 13:04:35 +01:00
Zed bddb6df567 Revert guest id workaround for now
Needs more testing
2020-01-19 12:31:52 +01:00
Zed 973ba585c7 Detect ?format=jpg/png images
Fixes #112
2020-01-19 09:01:11 +01:00
Zed edb3751181 Fix incorrect regex
Fixes #109
2020-01-19 08:49:28 +01:00
Zed ba57511a01 Add workaround for Twitter's layout A/B testing
Fixes #110
2020-01-19 08:34:32 +01:00
Zed 0924ea033d Catch failed guest token exception 2020-01-10 18:20:16 +01:00
Zed 23647f1d7f Add focus to photo rail links 2020-01-10 02:00:00 +01:00
Zed 662d25317f Add missing og:locale 2020-01-10 01:59:52 +01:00
Zed 2c6d2897ae Add experimental infinite scroll 2020-01-07 03:00:16 +01:00
Zed 2e97c1c98f Refactor timeline route 2020-01-07 02:23:20 +01:00
Kadin Buckton 39d824787a Fixes hardcoded href for OpenSearch xml 2020-01-03 10:17:38 -05:00
Kadin Buckton 8bffb61e68 Implements OpenSearch support, closes #107 2020-01-03 09:57:36 -05:00
Zed ee43d8cfb1 Catch SSL shutdown errors when closing clients 2020-01-01 17:24:24 +01:00
Zed 1aa1487402 Add t.co and /cards link resolvers
For t.co links: https://t.co/.. -> nitter.net/t.co/..
For card links: https://cards.twitter.com/cards/.. -> nitter.net/cards/...
2019-12-30 11:41:09 +01:00
Zed d27ab68a90 Redirect /statuses/ to /status/
Fixes #105
2019-12-30 10:58:15 +01:00
Zed a8d99cc685 Add donation details 2019-12-25 03:57:20 +01:00
Zed be15f1b001 Prevent 403 errors from outdated videos 2019-12-22 01:46:21 +01:00
Zed 7ef3a4faba Fix rare edge case where gifs get parsed as videos 2019-12-22 01:31:50 +01:00
Zed f8f4487c33 Support tweet locations 2019-12-21 05:44:58 +01:00
Zed 80d6191e74 Support media tags 2019-12-21 05:07:50 +01:00
Zed 80acfbc40d Make select element consistent across browsers
Hopefully..

Fixes #103
2019-12-21 03:09:12 +01:00
Zed 698ed8a85d
Merge pull request #102 from cyclopsian/int64
Change ID types to int64
2019-12-10 10:18:10 +01:00
Zed 8afad3b937 Fix broken profile RSS
Closes #99, closes #101
2019-12-10 10:11:55 +01:00
Jason Francis 5576cbac8d Change ID types to int64 2019-12-09 18:39:12 -05:00
Zed d6a2cd324f Remove user agent blacklist 2019-12-08 22:25:17 +01:00
Zed 8a2f4f63a3 Add query rule to include user thread replies 2019-12-08 20:00:55 +01:00
Zed 2e398c2c87 Include video ID in parser failure message 2019-12-08 19:48:11 +01:00
Zed 336cd6125c More user agent fixes 2019-12-08 13:45:35 +01:00
Zed 7863fe314e Remove CrOS from user agent generator
Most of them return limited results
2019-12-08 13:01:32 +01:00