Series: The Rust Annals
Vol. I Issue 52 nlopes.dev
Announcing Rust 1.51.0
Releases Const Generics MVP and Cargo's new feature resolver, marking pivotal shifts in type system expressiveness and dependency resolution.
Const Generics MVP
Before this release, Rust allowed you to have your types be parameterized over lifetimes or types. For example if we wanted to have a struct that is generic over the element type of an array, we’d write the following:
struct FixedArray<T> {
// ^^^ Type generic definition
list: [T; 32]
// ^ Where we're using it.
}
If we then use FixedArray<u8>, the compiler will make a monomorphic version of FixedArray that looks like:
struct FixedArray<u8> {
list: [u8; 32]
}
This is a powerful feature that allows you to write reusable code with no runtime overhead. However, until this release it hasn’t been possible to easily be generic over the values of those types. This was most notable in arrays which include their length in their type definition ([T; N]), which previously you could not be generic over. Now with 1.51.0 you can write code that is generic over the values of any integer, bool, or char type! (Using struct or enum values is still unstable.)
This change now lets us have our own array struct that’s generic over its type and its length. Let’s look at an example definition, and how it can be used.
struct Array<T, const LENGTH: usize> {
// ^^^^^^^^^^^^^^^^^^^ Const generic definition.
list: [T; LENGTH]
// ^^^^^^ We use it here.
}
Now if we then used Array<u8, 32>, the compiler will make a monomorphic version of Array that looks like:
struct Array<u8, 32> {
list: [u8; 32]
}
Const generics adds an important new tool for library designers in creating new, powerful compile-time safe APIs. If you’d like to learn more about const generics you can also check out the “Const Generics MVP Hits Beta” blog post for more information about the feature and its current restrictions. We can’t wait to see what new libraries and APIs you create!
array::IntoIter Stabilisation
As part of const generics stabilising, we’re also stabilising a new API that uses it, std::array::IntoIter. IntoIter allows you to create a by value iterator over any array. Previously there wasn’t a convenient way to iterate over owned values of an array, only references to them.
fn main() {
let array = [1, 2, 3, 4, 5];
// Previously
for item in array.iter().copied() {
println!("{}", item);
}
// Now
for item in std::array::IntoIter::new(array) {
println!("{}", item);
}
}
Note that this is added as a separate method instead of .into_iter() on arrays, as that currently introduces some amount of breakage; currently .into_iter() refers to the slice by-reference iterator. We’re exploring ways to make this more ergonomic in the future.
Cargo’s New Feature Resolver
Dependency management is a hard problem, and one of the hardest parts of it is just picking what version of a dependency to use when it’s depended on by two different packages. This doesn’t just include its version number, but also what features are or aren’t enabled for the package. Cargo’s default behaviour is to merge features for a single package when it’s referred to multiple times in the dependency graph.
For example, let’s say you had a dependency called foo with features A and B, which was being used by packages bar and baz, but bar depends on foo+A and baz depends on foo+B. Cargo will merge both of those features and compile foo as foo+AB. This has a benefit that you only have to compile foo once, and then it can be reused for both bar and baz.
However, this also comes with a downside. What if a feature enabled in a build-dependency is not compatible with the target you are building for?
A common example of this in the ecosystem is the optional std feature included in many #![no_std] crates, that allows crates to provide added functionality when std is available. Now imagine you want to use the #![no_std] version of foo in your #![no_std] binary, and use the foo at build time in your build.rs. If your build time dependency depends on foo+std, your binary now also depends on foo+std, which means it will no longer compile because std is not available for your target platform.
This has been a long-standing issue in cargo, and with this release there’s a new resolver option in your Cargo.toml, where you can set resolver="2" to tell cargo to try a new approach to resolving features. You can check out RFC 2957 for a detailed description of the behaviour, which can be summarised as follows.
- Dev dependencies — When a package is shared as a normal dependency and a dev-dependency, the dev-dependency features are only enabled if the current build is including dev-dependencies.
- Host Dependencies — When a package is shared as a normal dependency and a build-dependency or proc-macro, the features for the normal dependency are kept independent of the build-dependency or proc-macro.
- Target dependencies — When a package appears multiple times in the build graph, and one of those instances is a target-specific dependency, then the features of the target-specific dependency are only enabled if the target is currently being built.
While this can lead to some crates compiling more than once, this should provide a much more intuitive development experience when using features with cargo. If you’d like to know more, you can also read the “Feature Resolver” section in the Cargo Book for more information. We’d like to thank the cargo team and everyone involved for all their hard work in designing and implementing the new resolver!
[package]
resolver = "2"
# Or if you're using a workspace
[workspace]
resolver = "2"
Splitting Debug Information
While not often highlighted in the release, the Rust teams are constantly working on improving Rust’s compile times, and this release marks one of the largest improvements in a long time for Rust on macOS. Debug information maps the binary code back to your source code, so that the program can give you more information about what went wrong at runtime. In macOS, debug info was previously collected into a single .dSYM folder using a tool called dsymutil, which can take some time and use up quite a bit of disk space.
Collecting all of the debuginfo into this directory helps in finding it at runtime, particularly if the binary is being moved. However, it does have the drawback that even when you make a small change to your program, dsymutil will need to run over the entire final binary to produce the final .dSYM folder. This can sometimes add a lot to the build time, especially for larger projects, as all dependencies always get recollected, but this has been a necessary step as without it Rust’s standard library didn’t know how to load the debug info on macOS.
Recently, Rust backtraces switched to using a different backend which supports loading debuginfo without needing to run dsymutil, and we’ve stabilized support for skipping the dsymutil run. This can significantly speed up builds that include debuginfo and significantly reduce the amount of disk space used. We haven’t run extensive benchmarks, but have seen a lot of reports of people’s builds being a lot faster on macOS with this behavior.
You can enable this new behaviour by setting the -Csplit-debuginfo=unpacked flag when running rustc, or by setting the split-debuginfo [profile] option to unpacked in Cargo. The “unpacked” option instructs rustc to leave the .o object files in the build output directory instead of deleting them, and skips the step of running dsymutil. Rust’s backtrace support is smart enough to know how to find these .o files. Tools such as lldb also know how to do this. This should work as long as you don’t need to move the binary to a different location while retaining the debug information.
[profile.dev]
split-debuginfo = "unpacked"