rt_get_useragent {robotstxt} | R Documentation |
extracting HTTP useragents from robots.txt
Description
extracting HTTP useragents from robots.txt
Usage
rt_get_useragent(txt)
Arguments
txt |
content of the robots.txt file |
[Package robotstxt version 0.7.15 Index]