Popularity
0.7
Growing
Activity
4.7
Stable
5
2
0

Description

A configurable parallel web crawler, designed to crawl a website for URLs and file content.

Programming language: Rust
Tags: Web Programming     URL     HTML     Crawler    

url-crawler alternatives and related packages

Based on the "Web programming" category

Do you think we are missing an alternative of url-crawler or a related project?

Add another 'Web programming' Package

url-crawler Recommendations

There are no recommendations yet. Be the first to promote url-crawler!

Have you used url-crawler? Share your experience. Write a short recommendation and url-crawler, you and your project will be promoted on Awesome Rust.
Recommend url-crawler

Recently added url-crawler resources

Do you know of a usefull tutorial, book or news relevant to url-crawler?
Be the first to add one!