Skip to content

gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555)#149541

Closed
serhiy-storchaka wants to merge 1 commit into
python:mainfrom
serhiy-storchaka:robotparser-unreachable2
Closed

gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555)#149541
serhiy-storchaka wants to merge 1 commit into
python:mainfrom
serhiy-storchaka:robotparser-unreachable2

gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555)

a2fc8e8
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
DO-NOT-MERGE
succeeded May 8, 2026 in 3s