emo/thin-provisioning-tools
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
3d36456a36
thin-provisioning-tools/Cargo.toml

47 lines
715 B
TOML
Raw Normal View History

[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify)
2020-06-09 13:45:00 +05:30
[package]
name = "thinp"
version = "0.1.0"
authors = ["Joe Thornber <ejt@redhat.com>"]
edition = "2018"
license = "GPL3"
[dependencies]
[thin_check (rust)] move report creation to top level
2020-08-17 20:22:12 +05:30
atty = "0.2"
[thin_metadata_{pack,unpak}] use anyhow in toplevel.
2020-06-21 16:20:24 +05:30
anyhow = "1.0"
[build] Update dependencies - Update crc32c to 0.6, which allows it to be built on AArch64. - Update base64 to 0.13 - Update byteorder to 0.14 - Update io-uring to 0.4 - Update libc to 0.2.83 - Update nix to 0.19 - Update nom to 6.0.1 - Update quick-xml to 0.20 - Update rand to 0.8 - Update tempfile to 3.2 - Update tui to 0.14 Signed-off-by: Kay Lin <i@v2bv.net>
2021-01-23 14:11:01 +05:30
base64 = "0.13"
byteorder = "1.4"
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify)
2020-06-09 13:45:00 +05:30
clap = "2.33"
[build] Update dependencies - Update crc32c to 0.6, which allows it to be built on AArch64. - Update base64 to 0.13 - Update byteorder to 0.14 - Update io-uring to 0.4 - Update libc to 0.2.83 - Update nix to 0.19 - Update nom to 6.0.1 - Update quick-xml to 0.20 - Update rand to 0.8 - Update tempfile to 3.2 - Update tui to 0.14 Signed-off-by: Kay Lin <i@v2bv.net>
2021-01-23 14:11:01 +05:30
crc32c = "0.6"
[thin_explore] accept a node path on the command line Helpful to examine thin_check failures.
2020-09-21 18:23:21 +05:30
data-encoding = "2.3"
[functional-tests] Move thin_check functional tests to Rust. They'll be run as part of 'cargo test' now.
2020-07-31 15:34:12 +05:30
duct = "0.13"
[build] Update dependencies - Update fixedbitset to 0.4 - Update indicatif to 0.16 - Update libc to 0.2.* - Update nix to 0.21 - Update nom to 6.2.* - Update dependencies with cargo-update
2021-06-25 21:27:41 +05:30
fixedbitset = "0.4"
Merge branch 'master' into 2020-06-13-thin-check-rewrite
2020-07-27 20:23:26 +05:30
futures = "0.3"
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify)
2020-06-09 13:45:00 +05:30
flate2 = "1.0"
[build] Update dependencies - Update crc32c to 0.6, which allows it to be built on AArch64. - Update base64 to 0.13 - Update byteorder to 0.14 - Update io-uring to 0.4 - Update libc to 0.2.83 - Update nix to 0.19 - Update nom to 6.0.1 - Update quick-xml to 0.20 - Update rand to 0.8 - Update tempfile to 3.2 - Update tui to 0.14 Signed-off-by: Kay Lin <i@v2bv.net>
2021-01-23 14:11:01 +05:30
io-uring = "0.4"
[build] Update dependencies - Update fixedbitset to 0.4 - Update indicatif to 0.16 - Update libc to 0.2.* - Update nix to 0.21 - Update nom to 6.2.* - Update dependencies with cargo-update
2021-06-25 21:27:41 +05:30
indicatif = "0.16"
libc = "0.2"
Merge rust tools into a single pdata_tools exe
2021-10-11 16:37:26 +05:30
nix = "0.22"
[build] Update dependencies - Update fixedbitset to 0.4 - Update indicatif to 0.16 - Update libc to 0.2.* - Update nix to 0.21 - Update nom to 6.2.* - Update dependencies with cargo-update
2021-06-25 21:27:41 +05:30
nom = "6.2"
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify)
2020-06-09 13:45:00 +05:30
num_cpus = "1.13"
num-derive = "0.3"
[thin_metadata_{pack,unpak}] use anyhow in toplevel.
2020-06-21 16:20:24 +05:30
num-traits = "0.2"
[build] Update dependencies - Update fixedbitset to 0.4 - Update indicatif to 0.16 - Update libc to 0.2.* - Update nix to 0.21 - Update nom to 6.2.* - Update dependencies with cargo-update
2021-06-25 21:27:41 +05:30
quick-xml = "0.22"
[build] Update dependencies - Update crc32c to 0.6, which allows it to be built on AArch64. - Update base64 to 0.13 - Update byteorder to 0.14 - Update io-uring to 0.4 - Update libc to 0.2.83 - Update nix to 0.19 - Update nom to 6.0.1 - Update quick-xml to 0.20 - Update rand to 0.8 - Update tempfile to 3.2 - Update tui to 0.14 Signed-off-by: Kay Lin <i@v2bv.net>
2021-01-23 14:11:01 +05:30
rand = "0.8"
safemem = "0.3"
tempfile = "3.2"
[thin_check (rust)] First attempt at multithreading the tree walking. Still using a single io engine, so little benefit.
2020-07-29 21:08:52 +05:30
threadpool = "1.8"
[thin_metadata_{pack,unpak}] use anyhow in toplevel.
2020-06-21 16:20:24 +05:30
thiserror = "1.0"
[build] Update dependencies - Update crc32c to 0.6, which allows it to be built on AArch64. - Update base64 to 0.13 - Update byteorder to 0.14 - Update io-uring to 0.4 - Update libc to 0.2.83 - Update nix to 0.19 - Update nom to 6.0.1 - Update quick-xml to 0.20 - Update rand to 0.8 - Update tempfile to 3.2 - Update tui to 0.14 Signed-off-by: Kay Lin <i@v2bv.net>
2021-01-23 14:11:01 +05:30
tui = "0.14"
[thin_explore] First code drop
2020-09-16 19:40:01 +05:30
termion = "1.5"
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify)
2020-06-09 13:45:00 +05:30
[dev-dependencies]
[functional-tests] Move thin_check functional tests to Rust. They'll be run as part of 'cargo test' now.
2020-07-31 15:34:12 +05:30
json = "0.12"
[thin_metadata_pack/unpack] Replace C++ implementation with a Rust one. The Rust implementation is multithreaded, performs better in general and does custom compression of btree nodes to achieve much better compression ratios. unpack also checksums expanded metadata to validate it. Format version has jumped to 3, no backwards compatibility, but I think that's ok since we never made a release that contained the C++ version of these tools. Benchmarks ========== On an 8 core, 16 hyperthread machine. metadata 1G, full: Pack size pack time unpack time ------------------------------------------------------ C++ 193M 50.3s 6.9s (no verify) Rust 70M 1.4s 1.8s (verify) metadata 16G, sparse: Pack size pack time unpack time ------------------------------------------------------ C++ 21M 68s 1s (no verify) Rust 4M 8.6s 0.5s (verify)
2020-06-09 13:45:00 +05:30
quickcheck = "0.9"
quickcheck_macros = "0.9"
[thin_check (rust)] Add error handling to io_engine interface
2020-09-02 17:27:47 +05:30
[profile.release]
debug = true
[tests] Enable testing the rust targets This is a temporary solution for development. Usage: cargo test --features rust_tests
2021-06-18 19:54:23 +05:30
[features]
rust_tests = []
Reference in New Issue Copy Permalink