cobweb
Authors: Stewart McKee
License: MIT
Summary: Cobweb is a web crawler that can use resque to cluster crawls to quickly crawl extremely large sites which is much more performant than multi-threaded...
Can't find the visual you need? Build your own here
© 2026 ClickHouse, Inc. HQ in the Bay Area, CA and Amsterdam, NL.