Code

Rewrite get_robotstxt_http_get#94

Code

Merged

jrdnbradford merged 2 commits intomainropensci/robotstxt:mainfrom simplify-get_robotstxt_http_getropensci/robotstxt:simplify-get_robotstxt_http_getCopy head branch name to clipboardNov 15, 2024

+27-43

Commits

Commits on Nov 13, 2024

• Rewrite get_robotstxt_http_get

  jrdnbradford

  committed
  1634edd

  Copy full SHA for 1634edd

Commits on Nov 14, 2024

• Conditional header addition

  jrdnbradford

  committed
  d4256c0

  Copy full SHA for d4256c0