.Google confines robots.txt assistance to four areas, clarifying its own position on unsupported instructions.Google.com simply assists four specific robots.txt fields.Unsupported regulations in robots.txt will be overlooked.Consider bookkeeping your robots.txt data due to this upgrade.