rt_get_comments {robotstxt}R Documentation

extracting comments from robots.txt

Description

extracting comments from robots.txt

Usage

rt_get_comments(txt)

Arguments

txt

content of the robots.txt file


[Package robotstxt version 0.7.15 Index]