Skip to content

Make fetchTweetsPaging more robust #135

@MichaelCurrin

Description

@MichaelCurrin

Note on enumerate(cursor) line used in this fetchTweetsPaging.

This is prone to occasional errors which blocks the current next page,
unless one has a way to retry the page. If there entire script is
retried this can recover, but if there is a bad data issue on Twitter
or Tweepy handling then it would take low level looking at Tweepy
to debug and fix this (requiring a monkey match on Tweepy).

Sample:

tweepy.error.TweepError: Failed to parse JSON payload: Unterminated string starting at: line 1 column 913686 (char 913685)

site-packages/tweepy/parsers.py", line 91, in parse
json = JSONParser.parse(self, method, payload)

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions