1)   Web Bot Programming Library 1.0.0 Crawl the web with this free ActiveX web bot component. Advanced features include caching, "avoid" patterns, and robots.txt compliance.