blob: 5c687500271849e8c259c4ad61d0d92baccc4ee5 [file] [log] [blame] [view]
danakj6e25f742022-12-01 21:47:421# Rust in Chromium
2
3[TOC]
4
5# Why?
6
danakjbb4d0c772023-10-13 13:22:287Handling untrustworthy data in non-trivial ways is a major source of security
8bugs, and it's therefore against Chromium's security policies
9[to do it in the Browser or Gpu process](../docs/security/rule-of-2.md) unless
10you are working in a memory-safe language.
danakj6e25f742022-12-01 21:47:4211
12Rust provides a cross-platform memory-safe language so that all platforms can
13handle untrustworthy data directly from a privileged process, without the
14performance overheads and complexity of a utility process.
15
danakj6e25f742022-12-01 21:47:4216# Status
17
danakjbb4d0c772023-10-13 13:22:2818The Rust toolchain is enabled for and supports all platforms and development
19environments that are supported by the Chromium project. The first milestone
20to include full production-ready support was M119.
danakj6e25f742022-12-01 21:47:4221
danakjbb4d0c772023-10-13 13:22:2822Rust is approved by Chrome ATLs for production use in
23[certain third-party scenarios](../docs/adding_to_third_party.md#Rust).
danakj6e25f742022-12-01 21:47:4224
25For questions or help, reach out to `[email protected]` or `#rust` on the
26[Chromium Slack](https://www.chromium.org/developers/slack/).
27
danakj6e25f742022-12-01 21:47:4228If you use VSCode, we have [additional advice below](#using-vscode).
29
danakjbb4d0c772023-10-13 13:22:2830# Adding a third-party Rust library
danakj6e25f742022-12-01 21:47:4231
danakjbb4d0c772023-10-13 13:22:2832Third-party libraries are pulled from [crates.io](https://crates.io), but
33Chromium does not use Cargo as a build system.
danakj6e25f742022-12-01 21:47:4234
35## Third-party review
36
danakj6e25f742022-12-01 21:47:4237All third-party crates need to go through third-party review. See
38[//docs/adding_to_third_party.md](adding_to_third_party.md) for instructions on
39how to have a library reviewed.
40
danakjbb4d0c772023-10-13 13:22:2841## Importing a crate from crates.io
42
danakj0ec93d12023-11-17 16:12:2343The `//third_party/rust/chromium_crates_io/Cargo.toml` file defines the set of crates
danakjbb4d0c772023-10-13 13:22:2844depended on from first-party code. Any transitive dependencies will be found
danakj0ec93d12023-11-17 16:12:2345from those listed there. The file is a [standard `Cargo.toml` file](
46https://doc.rust-lang.org/cargo/reference/manifest.html), though the crate
47itself is never built, it is only used to collect dependencies through the
48`[dependencies]` section.
danakjbb4d0c772023-10-13 13:22:2849
danakj0ec93d12023-11-17 16:12:2350To use a third-party crate "bar" version 3 from first party code:
danakj98bec162023-11-21 14:55:02511. Change directory to the root `src/` dir of Chromium.
521. Add the crate to `//third_party/rust/chromium_crates_io/Cargo.toml`:
53 * `vpython3 ./tools/crates/run_gnrt.py add foo` to add the latest version of `foo`.
54 * `vpython3 ./tools/crates/run_gnrt.py add [email protected]` to add a specific version of `foo`.
55 * Or, directly through (nightly) cargo:
56 `cargo run --release --manifest-path tools/crates/gnrt/Cargo.toml --target-dir out/gnrt add foo`
57 * Or, edit the Cargo.toml by hand, finding the version you want from [crates.io](https://crates.io).
581. Download the crate's files:
59 * `./tools/crates/run_gnrt.py vendor` to download the new crate.
60 * Or, directly through (nightly) cargo:
danakj0ec93d12023-11-17 16:12:2361 `cargo run --release --manifest-path tools/crates/gnrt/Cargo.toml --target-dir out/gnrt vendor`
danakjf509caa2023-11-23 15:29:4362 * This will also apply any patches in `//third_party/rust/chromium_crates_io/patches`
63 for the crates. If a patch can not apply, the crate's download will be cancelled and
64 an error will be printed. See [patching errors](#patching-errors) below for how to resolve
65 this.
danakj98bec162023-11-21 14:55:02661. Add the new files to git:
67 * `git add -f third_party/rust/chromium_crates_io/vendor`
68 * The `-f` is important, as files may be skipped otherwise from a
69 `.gitignore` inside the crate.
701. If a crate in `//third_party/rust/chromium_crates_io/patches` was updated
danakj0ec93d12023-11-17 16:12:2371 as part of vendoring, then reapply patches to it:
danakj98bec162023-11-21 14:55:0272 * Go to the `//third_party/rust/chromium_crates_io` directory.
danakj0ec93d12023-11-17 16:12:2373 * `./apply_patches.sh` (this currently requires linux).
danakj98bec162023-11-21 14:55:02741. (optional) If the crate is only to be used by tests and tooling, then
75 specify the `"test"` group in `//third_party/rust/chromium_crates_io/gnrt_config.toml`:
76 ```
77 [crate.foo]
78 group = "test"
79 ```
801. Generate the `BUILD.gn` file for the new crate:
81 * `vpython3 ./tools/crates/run_gnrt.py gen`
82 * Or, directly through (nightly) cargo:
83 `cargo run --release --manifest-path tools/crates/gnrt/Cargo.toml --target-dir out/gnrt gen`
841. Upload the CL, mark any `unsafe` usage with `TODO` code review comments,
danakj0ec93d12023-11-17 16:12:2385 and include a link to it in the request for third-party and security review.
86
87### Cargo features
danakjbb4d0c772023-10-13 13:22:2888
89To enable a feature "spaceships" in the crate, change the entry in
danakj0ec93d12023-11-17 16:12:2390`//third_party/rust/chromium_crates_io/Cargo.toml` to include the feature:
danakjbb4d0c772023-10-13 13:22:2891```toml
92[dependencies]
93bar = { version = "3", features = [ "spaceships" ] }
94```
95
danakjf509caa2023-11-23 15:29:4396### Patching third-party crates
danakjbb4d0c772023-10-13 13:22:2897
98You may patch a crate in tree, but save any changes made into a diff file in
danakj98bec162023-11-21 14:55:0299a `//third_party/rust/chromium_crates_io/patches/` directory for the crate.
100The diff file should be generated by `git-format-patch` each new patch numbered
101consecutively so that they can be applied in order. For example, these files
102might exist if the "foo" crate was patched with a couple of changes:
danakjbb4d0c772023-10-13 13:22:28103
104```
danakj98bec162023-11-21 14:55:02105//third_party/rust/chromium_crates_io/patches/foo/patches/0001-Edit-the-Cargo-toml.diff
106//third_party/rust/chromium_crates_io/patches/foo/patches/0002-Other-changes.diff
danakjbb4d0c772023-10-13 13:22:28107```
108
Adrian Taylor138cb9f2023-11-08 18:41:54109The recommended procedure to create such patches is:
110
1111. Commit the plain new version of the crate to your local git branch
1122. Modify the crate as necessary
1133. Commit that modified version
1144. Use `git format-patch <unpatched version>` to generate the patch files
1155. Add the patch files in a new, third, commit
1166. Squash them, or rely on `git cl upload` doing so
117
danakjf509caa2023-11-23 15:29:43118#### Patching errors
119
120If `gnrt vendor` fails to apply a patch for a crate, it will cancel the download of that
121crate rather than leave it in a broken state. To recreate patches, first get a pristine
122copy of the crate by using the `--no-patches` argument:
123
1241. Download the crate without applying patches:
125 * `vpython3 ./tools/crates/run_gnrt.py vendor --no-patches=<CRATE_NAME>`
1262. Then recreate the patches as described in [Patching third-party crates](
127 #patching-third_party-crates).
128
129To verify the patches work, remove the vendored crate directory in
130`//third_party/rust/chromium_crates_io/vendor/`, named after the crate name
131and version. Then run the `vendor` action without `--no-patches` which will
132download the crate and apply the patches:
133 * `vpython3 ./tools/crates/run_gnrt.py vendor`
134
danakj98bec162023-11-21 14:55:02135## Security
danakjbb4d0c772023-10-13 13:22:28136
danakj98bec162023-11-21 14:55:02137If a shipping library needs security review (has any `unsafe`), and the review
138finds it's not satisfying the [rule of 2](../docs/security/rule-of-2.md), then
139move it to the `"sandbox"` group in `//third_party/rust/chromium_crates_io/gnrt_config.toml`
140to make it clear it can't be used in a privileged process:
141```
142[crate.foo]
143group = "sandbox"
144```
145
146If a transitive dependency moves from `"safe"` to `"sandbox"` and causes
147a dependency chain across the groups, it will break the `gnrt vendor` step.
148You will need to fix the new crate so that it's deemed safe in unsafe review,
149or move the other dependent crates out of `"safe"` as well by setting their
150group in `gnrt_config.toml`.
151
152# Updating existing third-party crates
153
154To update crates to their latest minor versions:
1551. Change directory to the root `src/` dir of Chromium.
1561. Update the versions in `//third_party/rust/chromium_crates_io/Cargo.lock`.
157 * `vpython3 ./tools/crates/run_gnrt.py update`
158 * Or, directly through (nightly) cargo:
159 `cargo run --release --manifest-path tools/crates/gnrt/Cargo.toml --target-dir out/gnrt update`
1601. Download any updated crate's files:
161 * `./tools/crates/run_gnrt.py vendor`
162 * Or, directly through (nightly) cargo:
163 `cargo run --release --manifest-path tools/crates/gnrt/Cargo.toml --target-dir out/gnrt vendor`
Lukasz Anforowicz8452bd8d2023-11-28 23:31:551641. Add the downloaded files to git:
danakj98bec162023-11-21 14:55:02165 * `git add -f third_party/rust/chromium_crates_io/vendor`
166 * The `-f` is important, as files may be skipped otherwise from a
167 `.gitignore` inside the crate.
1681. If a crate in `//third_party/rust/chromium_crates_io/patches` was updated
169 as part of vendoring, then reapply patches to it:
170 * Go to the `//third_party/rust/chromium_crates_io` directory.
171 * `./apply_patches.sh` (this currently requires linux).
1721. Generate the `BUILD.gn` files
173 * `vpython3 ./tools/crates/run_gnrt.py gen`
174 * Or, directly through (nightly) cargo:
175 `cargo run --release --manifest-path tools/crates/gnrt/Cargo.toml --target-dir out/gnrt gen`
Lukasz Anforowicz8452bd8d2023-11-28 23:31:551761. Add the generated files to git:
177 * `git add -f third_party/rust`
danakjbb4d0c772023-10-13 13:22:28178
179### Directory structure for third-party crates
180
181The directory structure for a crate "foo" version 3.4.2 is:
182```
183//third_party/
184 rust/
danakj98bec162023-11-21 14:55:02185 foo/ (for the "foo" crate)
Lukasz Anforowicz8452bd8d2023-11-28 23:31:55186 v3/ (version 3.4.2 maps to the v3 epoch)
danakjbb4d0c772023-10-13 13:22:28187 BUILD.gn (generated by gnrt gen)
danakj98bec162023-11-21 14:55:02188 README.chromium (generated by gnrt vendor)
Lukasz Anforowicz8452bd8d2023-11-28 23:31:55189 chromium_crates_io/
190 vendor/
191 foo-3.4.2 (crate sources downloaded from crates.io)
danakj98bec162023-11-21 14:55:02192 patches/
Lukasz Anforowicz8452bd8d2023-11-28 23:31:55193 foo/ (patches for the "foo" crate)
danakjbb4d0c772023-10-13 13:22:28194 0001-Edit-the-Cargo-toml.diff
195 0002-Other-changes.diff
Lukasz Anforowicz8452bd8d2023-11-28 23:31:55196 Cargo.toml
197 Cargo.lock
198 gnrt_config.toml
danakjbb4d0c772023-10-13 13:22:28199```
200
danakj6e25f742022-12-01 21:47:42201## Writing a wrapper for binding generation
202
203Most Rust libraries will need a more C++-friendly API written on top of them in
danakjbb4d0c772023-10-13 13:22:28204order to generate C++ bindings to them. The wrapper library can be placed
205in `//third_party/rust/<cratename>/<epoch>/wrapper` or at another single place
206that all C++ goes through to access the library. The [CXX](https://cxx.rs) is
207used to generate bindings between C++ and Rust.
danakj6e25f742022-12-01 21:47:42208
209See
danakjbb4d0c772023-10-13 13:22:28210[`//third_party/rust/serde_json_lenient/v0_1/wrapper/`](
211https://source.chromium.org/chromium/chromium/src/+/main:third_party/rust/serde_json_lenient/v0_1/wrapper/)
212and
213[`//components/qr_code_generator`](
214https://source.chromium.org/chromium/chromium/src/+/main:components/qr_code_generator/;l=1;drc=b185db5d502d4995627e09d62c6934590031a5f2)
215for examples.
danakj6e25f742022-12-01 21:47:42216
danakjbb4d0c772023-10-13 13:22:28217Rust libraries should use the
218[`rust_static_library`](
219https://source.chromium.org/chromium/chromium/src/+/main:build/rust/rust_static_library.gni)
220GN template (not the built-in `rust_library`) to integrate properly into the
221mixed-language Chromium build and get the correct compiler options applied to
222them.
danakj6e25f742022-12-01 21:47:42223
danakjbb4d0c772023-10-13 13:22:28224The [CXX](https://cxx.rs) tool is used for generating C++ bindings to Rust
225code. Since it requires explicit declarations in Rust, an wrapper shim around a
226pure Rust library is needed. Add these Rust shims that contain the CXX
227`bridge` macro to the `cxx_bindings` GN variable in the `rust_static_library`
228to have CXX generate a C++ header for that file. To include the C++ header
229file, rooted in the `gen` output directory, use
danakj6e25f742022-12-01 21:47:42230```
danakjbb4d0c772023-10-13 13:22:28231#include "the/path/to/the/rust/file.rs.h"
danakj6e25f742022-12-01 21:47:42232```
233
danakj6e25f742022-12-01 21:47:42234# Using VSCode
235
2361. Ensure you're using the `rust-analyzer` extension for VSCode, rather than
237 earlier forms of Rust support.
danakjbb4d0c772023-10-13 13:22:282382. Run `gn` with the `--export-rust-project` flag, such as:
239 `gn gen out/Release --export-rust-project`.
danakj6e25f742022-12-01 21:47:422403. `ln -s out/Release/rust-project.json rust-project.json`
2414. When you run VSCode, or any other IDE that uses
242 [rust-analyzer](https://rust-analyzer.github.io/) it should detect the
243 `rust-project.json` and use this to give you rich browsing, autocompletion,
244 type annotations etc. for all the Rust within the Chromium codebase.
danakjf3d7f372023-12-07 18:17:122455. Point rust-analyzer to the rust toolchain in Chromium. Otherwise you will
246 need to install Rustc in your system, and Chromium uses the nightly
247 compiler, so you would need that to match. Add the following to
248 `.vscode/settings.json` in the Chromium checkout:
249 ```
250 {
251 // The rest of the settings...
252
253 "rust-analyzer.cargo.extraEnv": {
254 "PATH": "../../third_party/rust-toolchain/bin:$PATH",
255 }
256 }
257 ```
258 This assumes you are working with an output directory like `out/Debug` which
259 has two levels; adjust the number of `..` in the path according to your own
260 setup.
Adrian Taylorc5fbb572023-11-21 14:25:42261
262# Using cargo
263
264If you are building a throwaway or experimental tool, you might like to use pure
265`cargo` tooling rather than `gn` and `ninja`. Even then, you may choose
266to restrict yourself to the toolchain and crates that are already approved for
267use in Chromium.
268
269Here's how.
270
271```
272export PATH_TO_CHROMIUM_SRC=~/chromium/src
273mkdir my-rust-tool
274cd my-rust-tool
275mkdir .cargo
276cat <<END > .cargo/config.toml
277[source.crates-io]
278replace-with = "vendored-sources"
279
280[source.vendored-sources]
281directory = "$PATH_TO_CHROMIUM_SRC/third_party/rust/chromium_crates_io/vendor"
282END
283$PATH_TO_CHROMIUM_SRC/third_party/rust-toolchain/bin/cargo init --offline
284$PATH_TO_CHROMIUM_SRC/third_party/rust-toolchain/bin/cargo run --offline
285```
286
287Most `cargo` tooling works well with this setup; one exception is `cargo add`,
288but you can still add dependencies manually to your `Cargo.toml`:
289
290```
291[dependencies]
292log = "0.4"
293```