Tweets not syncing

[eudemocracystiftung]

[opening a new issues w/ same title since I cannot reopen #232]

Hi, we are facing the same issue. When starting the containers, here is what comes out over and over:

2024-11-29 13:26:32 touitomamout  | 
2024-11-29 13:26:32 touitomamout  | Touitomamout@v1.8.0
2024-11-29 13:26:32 touitomamout  | 
2024-11-29 13:26:32 touitomamout  | ⚙️ cache        ✔ task finished
2024-11-29 13:26:32 touitomamout  | - connecting to twitter...
2024-11-29 13:26:32 touitomamout  | 🦤 client       ✔ connected as guest | replies will not be synced
2024-11-29 13:26:32 touitomamout  | - connecting to bluesky...
2024-11-29 13:26:33 touitomamout  | ☁️ client       ✔ connected
2024-11-29 13:26:34 touitomamout  | profile-sync    ✔ task finished
2024-11-29 13:26:35 touitomamout  | content-mapper  ✔ tweets: total: 0 retweets: 0 replies: 0 quotes: 0
2024-11-29 13:26:35 touitomamout  | content-mapper  ✔ task finished
2024-11-29 13:26:35 touitomamout  | 
2024-11-29 13:26:35 touitomamout  | 🦤 → 🦣+☁️
2024-11-29 13:26:35 touitomamout  | Touitomamout sync | v1.8.0
2024-11-29 13:26:35 touitomamout  | | Twitter handle: @appf_eu
2024-11-29 13:26:35 touitomamout  | | 00000  ʲᵘˢᵗ ˢʸⁿᶜᵉᵈ ᵖᵒˢᵗˢ
2024-11-29 13:26:35 touitomamout  | | 00000  ˢʸⁿᶜᵉᵈ ᵖᵒˢᵗˢ ˢᵒ ᶠᵃʳ
2024-11-29 13:26:37 touitomamout  | 

@unresolved-contradictions is your issue actually solved, then? if so, what solved it in the end?

We actually do not control the Twitter account but are attempting to provide a mirror of an official account on Bluesky until the account owner (an institution) decides to join. Hope this can work in the end.

Originally posted by @eudemocracystiftung in #232 (comment)

[c240amg]

Have you tried using a twitter login, rather than syncing unauthenticated? just thought it might be since it says connected as 'guest' ?

[eudemocracystiftung]

Thanks for the reply, @c240amg!
Just to be clear: I was under the impression that if I logged in with account X, this is necessarily the account that I would copy the tweets from; is that not the case? Because I am interested in copying tweets from an account I do not own, so I cannot log in from that account in particular. However, if that doens't matter, I can always create a dummy account.

[eudemocracystiftung]

Ok. I re-read more carefully the instructions and noticed the difference between twitter handle and twitter username. So I created a dummy account and used that to log in. However, the problem persists. Here is what I get over and over (the content below continuously loops):

2024-12-01 20:36:28 touitomamout  | Touitomamout@v1.8.0
2024-12-01 20:36:28 touitomamout  | 
2024-12-01 20:36:28 touitomamout  | ⚙️ cache        ✔ task finished
2024-12-01 20:36:28 touitomamout  | - connecting to twitter...
2024-12-01 20:36:31 touitomamout  | 🦤 client       ✔ connected (using credentials)
2024-12-01 20:36:32 touitomamout  | - connecting to bluesky...
2024-12-01 20:36:33 touitomamout  | ☁️ client       ✔ connected
2024-12-01 20:36:36 touitomamout  | profile-sync    ✔ task finished
2024-12-01 20:36:44 touitomamout  | content-mapper  ✔ tweets: total: 0 retweets: 0 replies: 0 quotes: 0
2024-12-01 20:36:44 touitomamout  | content-mapper  ✔ task finished
2024-12-01 20:36:44 touitomamout  | 
2024-12-01 20:36:44 touitomamout  | 🦤 → 🦣+☁️
2024-12-01 20:36:44 touitomamout  | Touitomamout sync | v1.8.0
2024-12-01 20:36:44 touitomamout  | | Twitter handle: @appf_eu
2024-12-01 20:36:44 touitomamout  | | 00000  ʲᵘˢᵗ ˢʸⁿᶜᵉᵈ ᵖᵒˢᵗˢ
2024-12-01 20:36:44 touitomamout  | | 00000  ˢʸⁿᶜᵉᵈ ᵖᵒˢᵗˢ ˢᵒ ᶠᵃʳ

So, all seems to go well but the mapper seems to find no tweets in the account for which I provide the handle. Also the fact that it constantly loops is surprising.

Side question: does capitalisation matter? The handle should be all caps and is entered as such in the .env file. However, it is not all caps in the extract above -- not sure whether this has an impact on the mapping.

EDIT: I tried deleting the cache, to be on the safe side, but that didn't work.
Here is what it contains:

{"version":"0.2","instance":{"id":"appf_eu"},"profile":{"avatar":"7bf94790f1bf0a11b54dd8e713c662adaaec6b5936268defeb5448f14c84e84c","banner":"6cd2820c4abb12290618f5a9c24e191b939198d5ff65a9826ca2a0e1067d3762"},"posts":{}}

[eudemocracystiftung]

PS: I realised that the loop was avoided by turning daemon mode to true, so that is sorted out.

[eudemocracystiftung]

Any ideas, @louisgrasset?

[eudemocracystiftung]

Update: I turned on sync for profile name and header, and that worked well. So the sync to Bluesky itself seems to work. The problem really seems to be getting the tweets from Twitter.

[Mte90]

I have the same issue with DAEMON as true and without an account user/psw.
Maybe the twitter-scrape project is not working anymore?

Also in my case is a new installation so I never executed touitomamaout so it should find some tweets (tried writing also some tweets but they are not found).

[karashiiro]

Copying my comment from the scraper repo here:

I went ahead and cloned touitomamout to try and get a better understanding of what's happening, and I'm fairly certain this is an issue on their end (either a bug or more likely a documentation issue).

Dropping a breakpoint here (and enabling sourcemaps from Vite) shows that the scraper is able to retrieve tweets, it's just that getEligibleTweet is returning undefined, signaling that everything in your account was filtered out. This is the line of code that determines whether or not a post is replicated - breaking it down, it roughly means:

1. The post must not be a retweet.
2. The post must not be a comment on one of your own posts.
3. The post must not be a QRT of one of your own posts.
4. The post must have been made in the past 3 weeks.

[eudemocracystiftung]

Thank you so much @karashiiro for taking all the time to check, this is amazing and I really hope what you found gets picked up by the good people here! I would really love to see this tool work. We have a public-interest project that makes use of it and we would love to see it through!

[Mte90]

So basically the project needs to alert when no tweet is eligible basically isntead of writing 0.

[eudemocracystiftung]

I don't think this is enough. In my case, at least, there should be many, many tweets that qualify (that do not match the four criteria above) and yet none are returned.

[unresolved-contradictions]

Apologies for the delay in responding. Is the Twitter account you are using to log in to Twitter verified?

Also instead of "TWITTER_USERNAME", I used "TWITTER_EMAIL" and it worked beautifully.

[Mte90]

In my case is my personal account and is not verified.
What I can see that if I open my account page in an anonymous window there is the request for a twitter login.

[eudemocracystiftung]

Apologies for the delay in responding. Is the Twitter account you are using to log in to Twitter verified?

Also instead of "TWITTER_USERNAME", I used "TWITTER_EMAIL" and it worked beautifully.

Hi, thanks for replying. No, the account is not verified, it's just a dummy account.

We just tried now by replacing "TWITTER_USERNAME" with "TWITTER_EMAIL", but this did not change.

Note, however, that logging in is not the issue in this thread (unlike here) -- the issue here is just that no tweets are mapped and, therefore, synced to Bluesky.

[eudemocracystiftung]

Any ideas on this? Just tested again and no tweets sync, even though the source account has published 107 tweets. It's not a lot, but some of those should definitely sync.