Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fantia不如以前直接使用token,现在用登录的经常出现429 Too Many Requests #57

Open
nowata opened this issue Aug 25, 2023 · 1 comment

Comments

@nowata
Copy link

nowata commented Aug 25, 2023

只抓取了不到三百个帖子就开始跳429,而且比较麻烦的是,电脑上的浏览器已经不跳429了,但打开炼精工房的浏览器时还是处于429的状态

@EndlessMISAKA
Copy link
Owner

emmm抱歉,最近都很少看github了。
目前这个新的方式只是省去你手动去浏览器获取token而已,而且根据fantia的网页安全设计,目前只有这个方案能稳定爬取了。
你应该是下载速度比较快的,所以每个帖子之间几乎都没有等待时间就一直下载,或者你的同时下载数量是不是有设置比较高?
我这边会追加设定一下每个帖子之间的等待时间,再看看会不会429吧。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants