blob: 39ed172ba606ddb1ae0265cbd7b29730966024c8 [file] [log] [blame] [view]
zpeng8d6f584a2016-12-16 20:50:281# Adding third_party Libraries
2
3[TOC]
4
5Using third party code can save time and is consistent with our values - no need
6to reinvent the wheel! We put all code that isn't written by Chromium developers
Dirk Pranke568e95c2018-11-01 23:41:507into `//third_party` (even if you end up modifying just a few functions). We do
zpeng8d6f584a2016-12-16 20:50:288this to make it easy to track license compliance, security patches, and supply
9the right credit and attributions. It also makes it a lot easier for other
10projects that embed our code to track what is Chromium licensed and what is
11covered by other licenses.
12
Dirk Pranke568e95c2018-11-01 23:41:5013## Put the code in //third_party
zpeng8d6f584a2016-12-16 20:50:2814
Dirk Pranke568e95c2018-11-01 23:41:5015By default, all code should be checked into [//third_party](../third_party/),
16for the reasons given above. Other locations are only appropriate in a few
17situations and need explicit approval; don't assume that because there's some
18other directory with third_party in the name it's okay to put new things
19there.
zpeng8d6f584a2016-12-16 20:50:2820
Tim van der Lippe5870ac32019-10-18 11:46:5421## Before you start
22
23To make sure the inclusion of a new third_party project makes sense for the
24Chromium project, you should first obtain Chrome Eng Review approval.
25Googlers should see go/chrome-eng-review and review existing topics in
26g/chrome-eng-review. Please include information about the additional checkout
John Abd-El-Malek988e2c02020-08-18 04:49:2427size, build times, and binary size increase of
28[official](https://www.chromium.org/developers/gn-build-configuration) builds
29on Android and one desktop platform. Please also make sure that the motivation
Tim van der Lippe5870ac32019-10-18 11:46:5430for your project is clear, e.g., a design doc has been circulated.
31
Dirk Pranke568e95c2018-11-01 23:41:5032## Get the code
zpeng8d6f584a2016-12-16 20:50:2833
Dirk Pranke568e95c2018-11-01 23:41:5034There are two common ways to depend on third-party code: you can reference a
Jason D. Clintonb21e99b2021-09-30 19:19:5835Git repo directly (via entries in the DEPS file) or you can check in a
36snapshot. The former is preferable in most cases:
37
381. If you are actively developing in the upstream repo, then having the DEPS
39 file include the upstream (that's been mirrored to GoB, see below) can be a
40 way to include those changes into Chromium at a particular revision. The
41 DEPS file will be updated to a new revision when you are ready to "roll" the
42 new version into Chromium. This also avoids duplicate copies of the code
43 showing up in multiple repos leading to contributor confusion.
441. This interacts favorably with our upstream tracking automation. We
45 automatically consume the upstream Git hashes and match them against a
46 database of known upstreams to tracking drift between Chromium and upstream
47 sources.
481. This makes adding deps that don't need local changes easier. E.g. some of
49 our automation automatically converts non-GN build rules into GN build rules
50 without any additional CLs.
51
52Checking in a snapshot is useful if this is effectively taking on maintenance
53of an unmaintained project (e.g. an ancient library that we're going to GN-ify
54that hasn't been updated in years). And, of course, if the code you need isn't
55in a Git repo, then you have to snapshot.
zpeng8d6f584a2016-12-16 20:50:2856
Tim van der Lippe5870ac32019-10-18 11:46:5457### Node packages
58
59To include a Node package, add the dependency to the
60[Node package.json](../third_party/node/package.json). Make sure to update
61the corresponding [`npm_exclude.txt`](../third_party/node/npm_exclude.txt)
62and [`npm_include.txt`](../third_party/node/npm_include.txt) to make the code
63available during checkout.
64
Dirk Pranke568e95c2018-11-01 23:41:5065### Pulling the code via DEPS
66
67If the code is in a Git repo that you want to mirror, please file an [infra git
68ticket](https://bugs.chromium.org/p/chromium/issues/entry?template=Infra-Git)
69to get the repo mirrored onto chromium.googlesource.com; we don't allow direct
70dependencies on non-Google-hosted repositories, so that we can still build
Jason D. Clintonb21e99b2021-09-30 19:19:5871if an external repository goes down.
Dirk Pranke568e95c2018-11-01 23:41:5072
73Once the mirror is set up, add an entry to [//DEPS](../DEPS) so that gclient
74will pull it in. If the code is only needed on some platforms, add a condition
75to the deps entry so that developers on other platforms don't pull in things
76they don't need.
77
78As for specifying the path where the library is fetched, a path like
79`//third_party/<project_name>/src` is highly recommended so that you can put
80the file like OWNERS or README.chromium at `//third_party/<project_name>`. If
81you have a wrong path in DEPS and want to change the path of the existing
82library in DEPS, please ask the infrastructure team before committing the
83change.
84
David Dorwin7fde299b2020-09-25 02:10:3485Lastly, add the new directory to Chromium's `//third_party/.gitignore`, so that
86it won't show up as untracked files when you run `git status` on the main
87repository.
Dirk Pranke568e95c2018-11-01 23:41:5088
89### Checking in the code directly
90
91If you are checking in a snapshot, please describe the source in the
92README.chromium file, described below. For security reasons, please retrieve
93the code as securely as you can, using HTTPS and GPG signatures if available.
94If retrieving a tarball, please do not check the tarball itself into the tree,
95but do list the source and the SHA-512 hash (for verification) in the
96README.chromium and Change List. The SHA-512 hash can be computed via
97`sha512sum` or `openssl dgst -sha512`. If retrieving from a git
98repository, please list the revision that the code was pulled from.
99
100If you are checking the files in directly, you do not need an entry in DEPS
David Dorwin7fde299b2020-09-25 02:10:34101and do not need to modify `//third_party/.gitignore`.
Dirk Pranke568e95c2018-11-01 23:41:50102
103### Checking in large files
104
105_Accessible to Googlers only. Non-Googlers can email one of the people in
106third_party/OWNERS for help.
107
108See [Moving large files to Google Storage](https://goto.google.com/checking-in-large-files)
109
110## Document the code's context
zpeng8d6f584a2016-12-16 20:50:28111
112### Add OWNERS
113
Forrest Fleming80f70212020-07-01 00:13:50114Your OWNERS file must either list two Chromium developer accounts as the first
115two lines or include a `file:` directive to an OWNERS file within the
116`third_party` directory that itself conforms to this criterion. This will ensure
zpeng8d6f584a2016-12-16 20:50:28117accountability for maintenance of the code over time. While there isn't always
118an ideal or obvious set of people that should go in OWNERS, this is critical for
119first-line triage of any issues that crop up in the code.
120
121As an OWNER, you're expected to:
122
123* Remove the dependency when/if it is no longer needed
124* Update the dependency when a security or stability bug is fixed upstream
125* Help ensure the Chrome feature that uses the dependency continues to use the
126 dependency in the best way, as the feature and the dependency change over
127 time.
128
129### Add a README.chromium
130
131You need a README.chromium file with information about the project from which
132you're re-using code. See
Dirk Pranke568e95c2018-11-01 23:41:50133[//third_party/README.chromium.template](../third_party/README.chromium.template)
zpeng8d6f584a2016-12-16 20:50:28134for a list of fields to include. A presubmit check will check this has the right
135format.
136
Dirk Pranke568e95c2018-11-01 23:41:50137README.chromium files contain a field indicating whether the package is
138security-critical or not. A package is security-critical if it is compiled
139into the product and does any of the following:
140
141* Accepts untrustworthy inputs from the internet
142* Parses or interprets complex input formats
143* Sends data to internet servers
144* Collects new data
145* Influences or sets security-related policy (including the user experience)
146
Adrian Taylor0a06ec32020-03-03 05:00:07147One of the fields is CPEPrefix. This is used by Chromium and Google systems to
148spot known upstream security vulnerabilities, and ensure we merge the fixes
149into our third-party copy. These systems are not foolproof, so as the OWNER,
150it's up to you to keep an eye out rather than solely relying on these
151automated systems. But, adding CPEs decreases the chances of us missing
152vulnerabilities, so they should always be added if possible.
153
154The CPE is a common format shared across the industry; you can look up the CPE
155for your package [here](https://nvd.nist.gov/products/cpe/search). Please use
156CPE format 2.2. When searching for a CPE, you may find that there is not yet
157a CPE for the specific upstream version you're using. This is normal, as CPEs
158are typically allocated only when a vulnerability is found. You should follow
159the version number convention such that, when that does occur in future, we'll
160be notified. If no CPE is available, please specify "unknown".
161
Adrian Taylor8e0d3fd2020-04-17 20:14:25162If you're using a patched or modified version which is halfway between two
163public versions, please "round downwards" to the lower of the public versions
164(it's better for us to be notified of false-positive vulnerabilities than
165false-negatives).
Adrian Taylor0a06ec32020-03-03 05:00:07166
zpeng8d6f584a2016-12-16 20:50:28167### Add a LICENSE file and run related checks
168
169You need a LICENSE file. Example:
Dirk Pranke568e95c2018-11-01 23:41:50170[//third_party/libjpeg/LICENSE](../third_party/libjpeg/LICENSE).
zpeng8d6f584a2016-12-16 20:50:28171
Dirk Pranke568e95c2018-11-01 23:41:50172Run `//tools/licenses.py scan`; this will complain about incomplete or missing
173data for third_party checkins. We use `licenses.py credits` to generate the
174about:credits page in Google Chrome builds.
zpeng8d6f584a2016-12-16 20:50:28175
176If the library will never be shipped as a part of Chrome (e.g. build-time tools,
177testing tools), make sure to set "License File" as "NOT_SHIPPED" so that the
Dirk Prankebf4136b2018-09-20 22:48:43178license is not included in about:credits page ([more on this below](#credits)).
zpeng8d6f584a2016-12-16 20:50:28179
Dirk Pranke568e95c2018-11-01 23:41:50180## Get a review
zpeng8d6f584a2016-12-16 20:50:28181
Aaron Gablefc8cdad2018-01-16 21:02:40182All third party additions and substantive changes like re-licensing need the
Dirk Pranke568e95c2018-11-01 23:41:50183following sign-offs. Some of these are accessible to Googlers only.
184Non-Googlers can email one of the people in
185[//third_party/OWNERS](../third_party/OWNERS) for help.
zpeng8d6f584a2016-12-16 20:50:28186
Tim van der Lippe8c7498392019-10-28 12:21:04187* Make sure you have the approval from Chrome Eng Review as mentioned
188 [above](#before-you-start).
Aaron Gablefc8cdad2018-01-16 21:02:40189* Get security@chromium.org approval. Email the list with relevant details and
190 a link to the CL. Third party code is a hot spot for security vulnerabilities.
191 When adding a new package that could potentially carry security risk, make
192 sure to highlight risk to security@chromium.org. You may be asked to add
193 a README.security or, in dangerous cases, README.SECURITY.URGENTLY file.
Dirk Pranke6fb90c02018-10-17 02:02:20194* Add chromium-third-party@google.com as a reviewer on your change. This
Adam Langley88658b32018-11-20 22:12:47195 will trigger an automatic round-robin assignment to a reviewer who will check
196 licensing matters. These reviewers may not be able to +1 a change so look for
197 verbal approval in the comments. (This list does not receive or deliver
198 email, so only use it as a reviewer, not for other communication. Internally,
Dirk Prankef7432812020-06-10 22:38:20199 see [cl/221704656](https://cl/221704656) for details about how
200 this is configured.). If you have questions about the third-party process,
201 ask one of the [//third_party/OWNERS](../third_party/OWNERS) instead.
Adam Langley88658b32018-11-20 22:12:47202* Lastly, if all other steps are complete, get a positive code review from a
203 member of [//third_party/OWNERS](../third_party/OWNERS) to land the change.
zpeng8d6f584a2016-12-16 20:50:28204
Dirk Pranke6fb90c02018-10-17 02:02:20205Please send separate emails to the eng review and security lists.
jochen893d5182017-01-31 22:01:49206
Dirk Pranke568e95c2018-11-01 23:41:50207Subsequent changes don't normally require third-party-owners or security
208approval; you can modify the code as much as you want. When you update code, be
209mindful of security-related mailing lists for the project and relevant CVE to
210update your package.
Dirk Prankebf4136b2018-09-20 22:48:43211
212## How we ensure that the right credits are displayed {#credits}
213
214As we said at the beginning, it is important that Chrome displays the
215right credit and attributions for all of the third_party code we use.
216
217To view this in chrome, you can open chrome://credits.
218
219That page displays a resource embedded in the browser as part of the
220[//components/resources/components_resources.grd](../components/resources/components_resource.grd)
221GRIT file; the actual HTML text is generated in the
222[//components/resources:about_credits](../components/resources/BUILD.gn)
223build target using a template from the output of the
224[//tools/licenses.py](../tools/licenses.py) script. Assuming you've followed
225the rules above to ensure that you have the proper LICENSE file and it passes
226the checks, it'll be included automatically.