All Versions
Latest Version
Avg Release Cycle
Latest Release

Changelog History

  • v0.3.0 Changes

    • ๐Ÿ‘ Allow scraping from multiple URLs in the same crawler.
    // This
    fn new(url: String) -> Self {}
    // Now becomes
    fn new(urls: impl Into<CrawlerSource>) -> Self {}
    // Which enables
    Crawler::new(vec!["url1".into(), "url2".into()]);
  • v0.2.1 Changes

    • The PreFetchCallback was not being called before fetching HEAD requests.
  • v0.2.0 Changes

    • Switch to using Arc<Fn()> callbacks instead of function pointers.
  • v0.1.1 Changes

    • โœ‚ Remove dependency on the failure crates
    • โž• Add the content_type field to UrlEntry::File
  • v0.1.0 Changes

    • ๐ŸŽ‰ Initial release