Skip to content

walterhpearce/crates-spider

Crate Spider

Spiders all crates from crates.io into a working directory.

Quick Start

  • Download all crates in parallel

cargo run -- --workdir workdir spider

Optional Argument: --only-most-recent for only the latest revision of a crate.

  • Extract all downloaded crates

cargo run -- --workdir workdir extract

Future Work

  • Sync mirror instead of forced redownload
  • Parallelization settings for load reduction
  • Download and extraction workdir layout configuration

The Rust Foundation has adopted a Code of Conduct that we expect project participants to adhere to. Please read the full text so that you can understand what actions will and will not be tolerated.

Contributing

See CONTRIBUTING.md.

Licenses

Rust is primarily distributed under the terms of both the MIT license and the Apache License (Version 2.0), with documentation portions covered by the Creative Commons Attribution 4.0 International license..

See LICENSE-APACHE, LICENSE-MIT, LICENSE-documentation, and COPYRIGHT for details.

You can also read more under the Foundation's intellectual property policy.

Trademark

The Rust Foundation owns and protects the Rust and Cargo trademarks and logos (the "Rust Trademarks").

If you want to use these names or brands, please read the media guide.

Access to this repo

Until the code is made public, access to this repo should be limited to those participating in the Rust Foundation's security initaitive. Please contact @walterhpearce to request access.

Other Policies

You can read about other Rust Fondation policies in the footer of the Foundation website.

About

No description, website, or topics provided.

Resources

License

Unknown and 2 other licenses found

Licenses found

Apache-2.0
LICENSE-APACHE
MIT
LICENSE-MIT
CC-BY-4.0
LICENSE-documentation

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published
pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy