Popularity
1.1
Growing
Activity
3.5
Declining
12
2
2

Description

A configurable parallel web crawler, designed to crawl a website for URLs and file content.

Monthly Downloads: 25
Programming language: Rust
License: MIT License
Tags: Web     Web Programming     URL     HTML     Crawler    

url-crawler alternatives and related packages

Based on the "Web programming" category

Do you think we are missing an alternative of url-crawler or a related project?

Add another 'Web programming' Package

url-crawler Recommendations

There are no recommendations yet. Be the first to promote url-crawler!

Have you used url-crawler? Share your experience. Write a short recommendation and url-crawler, you and your project will be promoted on Awesome Rust.
Recommend url-crawler

Recently added url-crawler resources

Do you know of a usefull tutorial, book or news relevant to url-crawler?
Be the first to add one!