Online Robots.txt File Scanner
Robots.txt file can expose something sensitive such as the path of an administration panel.
Short Info
Level
Information
Single Scan
Single Scan
Can be used by
Everyone
Estimated Time
10 sec
Scan only one
Url
Toolbox
-
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a text file with instructions for search engine crawlers. This file can expose something sensitive such as the path of an administration panel.
![cyber security services for everyone one. Free security tools, continuous vulnerability scanning and many more.](/_next/image?url=%2Fassets%2Fimages%2Fhome%2Fshield-256.png&w=640&q=75)
Try it yourself,
control security posture
control security posture