rt_get_comments {robotstxt}
R Documentation
extracting comments from robots.txt
Description
extracting comments from robots.txt
Usage
rt_get_comments(txt)
Arguments
txt
content of the robots.txt file
[Package
robotstxt
version 0.7.15
Index
]