Skip to content

Question 84: Botany collections website is giving errors. [KH - Botany] #1167

Answered by pdavisfmnh
rondlg asked this question in Q&A
Discussion options

You must be logged in to vote

The issue is the websites are getting hit by so many different web scraper/indexing bots all at the same time. Essentially causing the site to get a DDOS status and crashing the web server.

I'm in the process of moving the sites to new infrastructure that should better support the traffic load but also allow blocking of bot traffic we don't want scraping the sites.

Replies: 3 comments 1 reply

Comment options

rondlg
Aug 2, 2024
Maintainer Author

You must be logged in to vote
0 replies
Comment options

rondlg
Aug 2, 2024
Maintainer Author

You must be logged in to vote
1 reply
@pdavisfmnh
Comment options

Answer selected by rondlg
Comment options

rondlg
Aug 2, 2024
Maintainer Author

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
Dept:Botany This issue was either submitted by or refers to Botany web This issue related to the web in general Dept:Birds This issue was either submitted by or refers to Birds zendesk There is a zendesk ticket that relates to this issue
2 participants