Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Impact of recent Twitter updates #4

Open
BANKA2017 opened this issue Jun 30, 2023 · 11 comments
Open

Impact of recent Twitter updates #4

BANKA2017 opened this issue Jun 30, 2023 · 11 comments

Comments

@BANKA2017
Copy link
Owner

  • The bad one is now twitter rejects almost all anonymous requests.
  • The good one is that we support login and provide cookies.
@BANKA2017 BANKA2017 pinned this issue Jun 30, 2023
@BANKA2017
Copy link
Owner Author

BANKA2017 commented Jul 3, 2023 •
edited
Loading 

 ❯ tests/backend.online.test.js (21) 35476ms
   ✓ Guest token 5529ms
   ✓ UserInfo (3) 1496ms
   ❯ Tweets (5) 5914ms
     ✓ Tweet 3831ms
     ✓ With replies 3775ms
     ✓ Status 4184ms
     ✓ List 5913ms
     × Community 2616ms
   ✓ Search (2) 3317ms
   ✓ Album search (2) 3424ms
   ✓ Broadcast (1) 6030ms
   ✓ Audiospace (1) 4034ms
   ✓ Trends (might not supported in some region) (1) 1553ms
   ✓ Typeahead (1) 1300ms
   ✓ List (2) 1417ms
   ❯ Community (2) 1456ms
     × Info 1379ms
     ✓ Search 1455ms

Community information and timeline changed to require login (removed), other endpoints areavailable.

@n0099
Copy link

n0099 commented Jul 3, 2023

https://twitter.com/elonmusk/status/1675187969420828672

BANKA2017 referenced this issue Jul 5, 2023
@BANKA2017
feat: get open account's oauth token like Android app
42f2b79 
try: fix cloudflare workers endpoints (failed, unable to get open account with unknown issues)
fix: SearchTimeline endpoint for Android clients
fix: test cases for open account
update: when accessing an endpoint that does not require a guest_token, no longer check to refresh the guest_token
update: birdwatch for tweets
update: featuresValueList and graphqlQueryList
update: update bearer and open account while updating guest_token
@BANKA2017 BANKA2017 changed the title A bad news and a good news Impact of recent Twitter updates Jul 5, 2023
@BANKA2017
Copy link
Owner Author

The Rate limit of the timeline endpoint is very low. It is recommended that crawler users reduce the frequency of crawling, or add more proxies.

'x-rate-limit-limit': '50'

BANKA2017 referenced this issue Jul 12, 2023
@BANKA2017
feat: use search endpoint from legacy tweetdeck
11e3088 
fix: rss for most timeline endpoints
fix: use .mjs for build exports
fix: wrong bearer token to update in online endpoints
remove: cfworkers builder for github actions
update: use tweetdeck bearer token for crawler
update: use package crypto-es to replace create-hmac
update: archive script with new search endpoint
@BANKA2017
Copy link
Owner Author

BANKA2017/twitter-monitor-assets@6e7ab33

@BANKA2017 BANKA2017 reopened this Aug 15, 2023
@bestRunner
Copy link

匿名请求已无法使用关键词搜索

@BANKA2017
Copy link
Owner Author

BANKA2017 commented Aug 18, 2023 •
edited
Loading

I need a little more time to fix it, before that, you can refer to zedeus/nitter#983 (comment) to obtain guest accounts and then create a new object:

{
    "authorization": "Bearer AAAAAAAAAAAAAAAAAAAAAFXzAwAAAAAAMHCxpeSDG1gLNLghVe8d74hl6k4%3DRUMF4xAQLsbeBhTSRrCiQpJtxoGWeyHrDb5te2jpGskWDFW82F",
    "oauth_token": "1680000071584518144-SVdJOzLojjUy00000T2Snv00000tnR",
    "oauth_token_secret": "OFYvbr00000IIzkHgytbNBfPbwp00000ynF5600000zUa"
}

and finally modify the code:

- ANY_VARIABLE = new GuestToken() // ANY_VARIABLE refers to a type of variables, they have many names
+ ANY_VARIABLE = new GuestToken('android')

- await ANY_VARIABLE.updateGuestToken(4) // May be any number from 0 to 4
+ await ANY_VARIABLE.openAccountInit({
+     "authorization": "Bearer AAAAAAAAAAAAAAAAAAAAAFXzAwAAAAAAMHCxpeSDG1gLNLghVe8d74hl6k4%3DRUMF4xAQLsbeBhTSRrCiQpJtxoGWeyHrDb5te2jpGskWDFW82F",
+     "oauth_token": "1680000071584518144-SVdJOzLojjUy00000T2Snv00000tnR",
+     "oauth_token_secret": "OFYvbr00000IIzkHgytbNBfPbwp00000ynF5600000zUa"
+ })

@BANKA2017
Copy link
Owner Author

BANKA2017 commented Aug 19, 2023 •
edited
Loading

Now I can no longer get any new guest accounts.

BANKA2017 referenced this issue Aug 30, 2023
@BANKA2017
feat: init an open account pool
25c217e 
fix: crash when function getAudioSpace() return a reject
@BANKA2017
Copy link
Owner Author

BANKA2017 commented Dec 11, 2023 •
edited
Loading

It seems that Twitter restored the timeline order of Enterprise Certified (Gold Marked) accounts under anonymous access.
image

@bestRunner
Copy link

It seems that Twitter restored the timeline order of Enterprise Certified (Gold Marked) accounts under anonymous access. image

应该并不是所有的主页都可以完全显示，例如：https://twitter.com/iPaulCanada，在登陆和无痕模式访问状态下，无痕模式依旧无法显示最新的内容

@BANKA2017
Copy link
Owner Author

https://twitter.com/iPaulCanada，在登陆和无痕模式访问状态下，无痕模式依旧无法显示最新的内容

only for gold marked accounts @bestRunner

@BANKA2017
Copy link
Owner Author

BANKA2017 commented Jan 28, 2024 •
edited
Loading

The core of Open-Twitter-Monitor will stop updating until a common solution other than guest account authentication is found.

Other parts, such as webpush, media downloader（except audio space）, rate limit checker, etc. are not affected.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@n0099 @BANKA2017 @bestRunner