Version 0.1

First stable feature complete release!

• Full support for Google's Robots.txt Specifications

Almost every aspect of the official robots.txt specifications has been tested and lots of bugs has been fixed.