Commit Graph

56 Commits

Author SHA1 Message Date
Zed 4120558649 Replace /.tokens with /.health and /.accounts 2023-10-31 12:04:32 +00:00
LS 735b30c2da
fix(nitter): add graphql user search (#1047)
* fix(nitter): add graphql user search

* fix(nitter): rm gitignore 2nd guest_accounts

* fix(nitter): keep query from user search in result. remove personal mods

* fix(nitter): removce useless line gitignore
2023-10-30 12:13:06 +00:00
Zed 7d14789910 Improve guest accounts loading, add JSONL support 2023-09-18 18:26:01 +00:00
Zed 84dcf49079 Fix negative pending requests bug 2023-08-31 05:07:12 +02:00
Zed 282ce8b0e9 Add 429 logging 2023-08-31 01:29:54 +02:00
Zed 37b58a5a7e Fix accounts logging 2023-08-30 03:43:49 +02:00
Zed 898b19b92f Improve rate limit handling, minor refactor 2023-08-30 03:10:21 +02:00
Zed 4ccf350dc7 Improve .tokens output 2023-08-29 23:45:18 +02:00
Zed ae9fa02bf5 Switch to TweetDetail for tweets 2023-08-25 16:28:30 +02:00
Zed 45808361af Fix tweetDetail stats 2023-08-22 04:45:49 +02:00
Zed 6e8744943f Tweak /.tokens, add amount of limited accounts 2023-08-22 03:43:18 +02:00
Zed 30bdf3a14e Reduce max concurrent pending requests per account 2023-08-22 01:32:28 +02:00
Zed 12504bcffe
Fix compilation error 2023-08-21 18:12:06 +02:00
Zed c3d9441370
Unify some guest account logs 2023-08-21 14:49:50 +02:00
Zed 3d8858f0d8 Track rate limits, reset after 24 hours 2023-08-20 11:56:42 +02:00
Zed bbd68e6840 Filter out account limits that already reset 2023-08-19 01:13:36 +02:00
Zed 3572dd7771 Replace tokens with guest accounts, swap endpoints 2023-08-19 00:25:14 +02:00
Zed 624394430c Use legacy timeline/user endpoint for Tweets tab 2023-08-08 02:09:56 +02:00
Zed 72d8f35cd1 Search isn't rate limited 2023-07-22 04:06:04 +02:00
Zed cc5841df30 Use old timeline endpoint 2023-07-21 18:56:39 +02:00
Zed 67203a431d Add back search 2023-07-12 03:37:44 +02:00
Zed 0bc3c153d9
Fix everything (#927)
* Switch bearer token and endpoints, update parser

* Enable user search, disable tweet search

* Disable multi-user timelines for now

* Fix parsing of pinned tombstone
2023-07-10 11:25:34 +02:00
Zed 1ac389e7c7
GraphQL timeline (#812)
* Update deps

* Replace profile timeline with GraphQL endpoint

* Update GraphQL endpoint versions

* Use GraphQL for profile media tab

* Fix UserByRestId request

* Improve routing, fixes #814

* Fix token pool JSON

* Deduplicate GraphQL timeline endpoints

* Update list endpoints

* Use GraphQL for list tweets

* Remove debug leftover

* Replace old pinned tweet endpoint with GraphQL

* Validate tweet ID

* Minor token handling fix

* Hide US-only commerce cards

* Update config example

* Remove http pool and gzip from token pool

* Support tombstoned tweets in threads

* Retry GraphQL timeout errors

* Remove unnecessary 401 retry

* Remove broken timeout retry

* Update karax, use new bool attribute feature

* Update card test

* Fix odd edgecase with broken retweets

* Replace search endpoints, switch Bearer token

* Only parse user search if it's a list

* Fix quoted tweet crash

* Fix empty search query handling

* Fix invalid user search errors again
2023-04-21 14:41:30 +02:00
Zed 670a3bca6e Revert "Revert "Replace tweet endpoint with GraphQL""
This reverts commit 36c72f9860.
2023-02-24 01:01:22 +01:00
Zed 36c72f9860 Revert "Replace tweet endpoint with GraphQL"
This reverts commit 19adc658c3.
2023-02-02 12:38:58 +01:00
Zed 19adc658c3 Replace tweet endpoint with GraphQL 2023-02-02 12:31:49 +01:00
Zed ff61d97a1d Optimize profile fetching and caching 2023-01-20 04:55:42 +01:00
Zed adaa94d998 Add more logging to the token pool 2022-06-05 21:47:25 +02:00
Zed c9b451d3ea Set listMembers max remaining to 500 2022-01-24 12:29:03 +01:00
Zed 51ae076ea0 Rearchitect profile, support pins, Profile -> User 2022-01-23 07:23:09 +01:00
Zed 43b0bdc08a Remove user agents 2022-01-17 04:13:27 +01:00
Zed 3d91ae0256 Set tokens to expire 5 minutes early
Prevents occasional usage of tokens the very second they expire
2022-01-16 17:57:18 +01:00
Zed d4c6876bc9 Add more info to /.tokens endpoint 2022-01-06 00:42:18 +01:00
Zed 4d9fd1a6f8 Use int for token reset instead of Time 2022-01-06 00:19:09 +01:00
Zed 34964f9e56 Track pending token requests to limit concurrency 2022-01-05 23:52:45 +01:00
Zed f9c9b0d3a4 Add /.tokens debug endpoint to see token pool 2022-01-05 22:49:16 +01:00
Zed dd71e60f35 Track token rate limits per endpoint 2022-01-05 22:48:45 +01:00
Zed 74c4377198 More cleanup 2022-01-02 11:21:03 +01:00
Zed 73b5b60ac3 Add license headers
Closes #413
2021-12-27 02:37:38 +01:00
Zed 3da6c50cb8 Use gzip for API calls to lower bandwidth and RAM 2021-12-26 06:49:27 +01:00
Zed 5b185c79de Improve token management logic 2021-12-20 04:19:11 +01:00
Ryan Koppenhaver 669aa2cd8b
parse token from int or str (#405) 2021-07-01 14:33:40 +02:00
Zed 67e15bb492 Temporary (?) fix for false rate limits 2021-01-18 07:57:39 +01:00
Zed 51b1567af6 Improve token pool to prevent rate limits 2021-01-13 14:32:26 +01:00
Zed 4e1d213488 Show error page when rate limited 2021-01-07 22:31:29 +01:00
Zed 3bd0488c66 Add http pool to reduce connection overhead 2020-11-07 21:31:03 +01:00
Zed 514d1b3121 Add temporary token fail safe 2020-07-09 09:18:36 +02:00
Zed 4c1270b377 Use old API endpoint to fetch tokens 2020-06-24 15:02:34 +02:00
Zed bde3c3662d Silence some warnings 2020-06-22 03:50:16 +02:00
Zed db100bbf17 Temporary fix to prevent early token expiry 2020-06-19 09:45:24 +02:00