Announcing the beta release of SnowCrawl, a python library for directed webcrawls. Nice features include: saved state for backup, support for threading and client-server architecture, lots of flexibility.
The project is open source, hosted at google code. More details to follow.
No comments:
Post a Comment