Shawn O. Pearce | 3e54819 | 2008-11-04 11:19:36 -0800 | [diff] [blame] | 1 | repo Manifest Format |
| 2 | ==================== |
| 3 | |
| 4 | A repo manifest describes the structure of a repo client; that is |
| 5 | the directories that are visible and where they should be obtained |
| 6 | from with git. |
| 7 | |
| 8 | The basic structure of a manifest is a bare Git repository holding |
| 9 | a single 'default.xml' XML file in the top level directory. |
| 10 | |
| 11 | Manifests are inherently version controlled, since they are kept |
| 12 | within a Git repository. Updates to manifests are automatically |
| 13 | obtained by clients during `repo sync`. |
| 14 | |
| 15 | |
| 16 | XML File Format |
| 17 | --------------- |
| 18 | |
| 19 | A manifest XML file (e.g. 'default.xml') roughly conforms to the |
| 20 | following DTD: |
| 21 | |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 22 | <!DOCTYPE manifest [ |
Doug Anderson | 2b8db3c | 2010-11-01 15:08:06 -0700 | [diff] [blame] | 23 | <!ELEMENT manifest (notice?, |
| 24 | remote*, |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 25 | default?, |
Nico Sallembien | a1bfd2c | 2010-04-06 10:40:01 -0700 | [diff] [blame] | 26 | manifest-server?, |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 27 | remove-project*, |
Doug Anderson | 37282b4 | 2011-03-04 11:54:18 -0800 | [diff] [blame] | 28 | project*, |
| 29 | repo-hooks?)> |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 30 | |
Doug Anderson | 2b8db3c | 2010-11-01 15:08:06 -0700 | [diff] [blame] | 31 | <!ELEMENT notice (#PCDATA)> |
| 32 | |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 33 | <!ELEMENT remote (EMPTY)> |
| 34 | <!ATTLIST remote name ID #REQUIRED> |
Yestin Sun | b292b98 | 2012-07-02 07:32:50 -0700 | [diff] [blame] | 35 | <!ATTLIST remote alias CDATA #IMPLIED> |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 36 | <!ATTLIST remote fetch CDATA #REQUIRED> |
| 37 | <!ATTLIST remote review CDATA #IMPLIED> |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 38 | |
| 39 | <!ELEMENT default (EMPTY)> |
| 40 | <!ATTLIST default remote IDREF #IMPLIED> |
| 41 | <!ATTLIST default revision CDATA #IMPLIED> |
Shawn O. Pearce | 6392c87 | 2011-09-22 17:44:31 -0700 | [diff] [blame] | 42 | <!ATTLIST default sync-j CDATA #IMPLIED> |
Anatol Pomazau | 79770d2 | 2012-04-20 14:41:59 -0700 | [diff] [blame] | 43 | <!ATTLIST default sync-c CDATA #IMPLIED> |
Che-Liang Chiou | b2bd91c | 2012-01-11 11:28:42 +0800 | [diff] [blame] | 44 | <!ATTLIST default sync-s CDATA #IMPLIED> |
Nico Sallembien | a1bfd2c | 2010-04-06 10:40:01 -0700 | [diff] [blame] | 45 | |
| 46 | <!ELEMENT manifest-server (EMPTY)> |
| 47 | <!ATTLIST url CDATA #REQUIRED> |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 48 | |
Che-Liang Chiou | b2bd91c | 2012-01-11 11:28:42 +0800 | [diff] [blame] | 49 | <!ELEMENT project (annotation?, |
| 50 | project*)> |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 51 | <!ATTLIST project name CDATA #REQUIRED> |
| 52 | <!ATTLIST project path CDATA #IMPLIED> |
| 53 | <!ATTLIST project remote IDREF #IMPLIED> |
| 54 | <!ATTLIST project revision CDATA #IMPLIED> |
Colin Cross | 5acde75 | 2012-03-28 20:15:45 -0700 | [diff] [blame] | 55 | <!ATTLIST project groups CDATA #IMPLIED> |
Anatol Pomazau | 79770d2 | 2012-04-20 14:41:59 -0700 | [diff] [blame] | 56 | <!ATTLIST project sync-c CDATA #IMPLIED> |
Che-Liang Chiou | b2bd91c | 2012-01-11 11:28:42 +0800 | [diff] [blame] | 57 | <!ATTLIST project sync-s CDATA #IMPLIED> |
David Pursehouse | 4e46520 | 2012-11-27 22:20:10 +0900 | [diff] [blame^] | 58 | <!ATTLIST project upstream CDATA #IMPLIED> |
James W. Mills | 24c1308 | 2012-04-12 15:04:13 -0500 | [diff] [blame] | 59 | |
| 60 | <!ELEMENT annotation (EMPTY)> |
| 61 | <!ATTLIST annotation name CDATA #REQUIRED> |
| 62 | <!ATTLIST annotation value CDATA #REQUIRED> |
| 63 | <!ATTLIST annotation keep CDATA "true"> |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 64 | |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 65 | <!ELEMENT remove-project (EMPTY)> |
| 66 | <!ATTLIST remove-project name CDATA #REQUIRED> |
Doug Anderson | 37282b4 | 2011-03-04 11:54:18 -0800 | [diff] [blame] | 67 | |
| 68 | <!ELEMENT repo-hooks (EMPTY)> |
| 69 | <!ATTLIST repo-hooks in-project CDATA #REQUIRED> |
| 70 | <!ATTLIST repo-hooks enabled-list CDATA #REQUIRED> |
Brian Harring | 2644874 | 2011-04-28 05:04:41 -0700 | [diff] [blame] | 71 | |
| 72 | <!ELEMENT include (EMPTY)> |
| 73 | <!ATTLIST include name CDATA #REQUIRED> |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 74 | ]> |
Shawn O. Pearce | 3e54819 | 2008-11-04 11:19:36 -0800 | [diff] [blame] | 75 | |
| 76 | A description of the elements and their attributes follows. |
| 77 | |
| 78 | |
| 79 | Element manifest |
| 80 | ---------------- |
| 81 | |
| 82 | The root element of the file. |
| 83 | |
| 84 | |
| 85 | Element remote |
| 86 | -------------- |
| 87 | |
| 88 | One or more remote elements may be specified. Each remote element |
| 89 | specifies a Git URL shared by one or more projects and (optionally) |
| 90 | the Gerrit review server those projects upload changes through. |
| 91 | |
| 92 | Attribute `name`: A short name unique to this manifest file. The |
| 93 | name specified here is used as the remote name in each project's |
| 94 | .git/config, and is therefore automatically available to commands |
| 95 | like `git fetch`, `git remote`, `git pull` and `git push`. |
| 96 | |
Yestin Sun | b292b98 | 2012-07-02 07:32:50 -0700 | [diff] [blame] | 97 | Attribute `alias`: The alias, if specified, is used to override |
| 98 | `name` to be set as the remote name in each project's .git/config. |
| 99 | Its value can be duplicated while attribute `name` has to be unique |
| 100 | in the manifest file. This helps each project to be able to have |
| 101 | same remote name which actually points to different remote url. |
| 102 | |
Shawn O. Pearce | 3e54819 | 2008-11-04 11:19:36 -0800 | [diff] [blame] | 103 | Attribute `fetch`: The Git URL prefix for all projects which use |
| 104 | this remote. Each project's name is appended to this prefix to |
| 105 | form the actual URL used to clone the project. |
| 106 | |
| 107 | Attribute `review`: Hostname of the Gerrit server where reviews |
| 108 | are uploaded to by `repo upload`. This attribute is optional; |
| 109 | if not specified then `repo upload` will not function. |
| 110 | |
Shawn O. Pearce | 3e54819 | 2008-11-04 11:19:36 -0800 | [diff] [blame] | 111 | Element default |
| 112 | --------------- |
| 113 | |
| 114 | At most one default element may be specified. Its remote and |
| 115 | revision attributes are used when a project element does not |
| 116 | specify its own remote or revision attribute. |
| 117 | |
| 118 | Attribute `remote`: Name of a previously defined remote element. |
| 119 | Project elements lacking a remote attribute of their own will use |
| 120 | this remote. |
| 121 | |
| 122 | Attribute `revision`: Name of a Git branch (e.g. `master` or |
| 123 | `refs/heads/master`). Project elements lacking their own |
| 124 | revision attribute will use this revision. |
| 125 | |
David Pursehouse | 4e46520 | 2012-11-27 22:20:10 +0900 | [diff] [blame^] | 126 | Attribute `sync_j`: Number of parallel jobs to use when synching. |
| 127 | |
| 128 | Attribute `sync_c`: Set to true to only sync the given Git |
| 129 | branch (specified in the `revision` attribute) rather than the |
| 130 | whole ref space. Project elements lacking a sync_c element of |
| 131 | their own will use this value. |
| 132 | |
| 133 | Attribute `sync_s`: Set to true to also sync sub-projects. |
| 134 | |
Shawn O. Pearce | 3e54819 | 2008-11-04 11:19:36 -0800 | [diff] [blame] | 135 | |
Nico Sallembien | a1bfd2c | 2010-04-06 10:40:01 -0700 | [diff] [blame] | 136 | Element manifest-server |
| 137 | ----------------------- |
| 138 | |
| 139 | At most one manifest-server may be specified. The url attribute |
| 140 | is used to specify the URL of a manifest server, which is an |
David Pursehouse | 9a27d01 | 2012-08-21 14:23:49 +0900 | [diff] [blame] | 141 | XML RPC service. |
Nico Sallembien | a1bfd2c | 2010-04-06 10:40:01 -0700 | [diff] [blame] | 142 | |
David Pursehouse | 9a27d01 | 2012-08-21 14:23:49 +0900 | [diff] [blame] | 143 | The manifest server should implement the following RPC methods: |
Nico Sallembien | a1bfd2c | 2010-04-06 10:40:01 -0700 | [diff] [blame] | 144 | |
| 145 | GetApprovedManifest(branch, target) |
| 146 | |
David Pursehouse | 9a27d01 | 2012-08-21 14:23:49 +0900 | [diff] [blame] | 147 | Return a manifest in which each project is pegged to a known good revision |
| 148 | for the current branch and target. |
| 149 | |
Nico Sallembien | a1bfd2c | 2010-04-06 10:40:01 -0700 | [diff] [blame] | 150 | The target to use is defined by environment variables TARGET_PRODUCT |
| 151 | and TARGET_BUILD_VARIANT. These variables are used to create a string |
| 152 | of the form $TARGET_PRODUCT-$TARGET_BUILD_VARIANT, e.g. passion-userdebug. |
| 153 | If one of those variables or both are not present, the program will call |
David Pursehouse | daa851f | 2012-08-21 13:52:18 +0900 | [diff] [blame] | 154 | GetApprovedManifest without the target parameter and the manifest server |
Nico Sallembien | a1bfd2c | 2010-04-06 10:40:01 -0700 | [diff] [blame] | 155 | should choose a reasonable default target. |
| 156 | |
David Pursehouse | 9a27d01 | 2012-08-21 14:23:49 +0900 | [diff] [blame] | 157 | GetManifest(tag) |
| 158 | |
| 159 | Return a manifest in which each project is pegged to the revision at |
| 160 | the specified tag. |
| 161 | |
Nico Sallembien | a1bfd2c | 2010-04-06 10:40:01 -0700 | [diff] [blame] | 162 | |
Shawn O. Pearce | 3e54819 | 2008-11-04 11:19:36 -0800 | [diff] [blame] | 163 | Element project |
| 164 | --------------- |
| 165 | |
| 166 | One or more project elements may be specified. Each element |
| 167 | describes a single Git repository to be cloned into the repo |
Che-Liang Chiou | b2bd91c | 2012-01-11 11:28:42 +0800 | [diff] [blame] | 168 | client workspace. You may specify Git-submodules by creating a |
| 169 | nested project. Git-submodules will be automatically |
| 170 | recognized and inherit their parent's attributes, but those |
| 171 | may be overridden by an explicitly specified project element. |
Shawn O. Pearce | 3e54819 | 2008-11-04 11:19:36 -0800 | [diff] [blame] | 172 | |
| 173 | Attribute `name`: A unique name for this project. The project's |
| 174 | name is appended onto its remote's fetch URL to generate the actual |
| 175 | URL to configure the Git remote with. The URL gets formed as: |
| 176 | |
| 177 | ${remote_fetch}/${project_name}.git |
| 178 | |
| 179 | where ${remote_fetch} is the remote's fetch attribute and |
| 180 | ${project_name} is the project's name attribute. The suffix ".git" |
David Pursehouse | daa851f | 2012-08-21 13:52:18 +0900 | [diff] [blame] | 181 | is always appended as repo assumes the upstream is a forest of |
Che-Liang Chiou | b2bd91c | 2012-01-11 11:28:42 +0800 | [diff] [blame] | 182 | bare Git repositories. If the project has a parent element, its |
| 183 | name will be prefixed by the parent's. |
Shawn O. Pearce | 3e54819 | 2008-11-04 11:19:36 -0800 | [diff] [blame] | 184 | |
| 185 | The project name must match the name Gerrit knows, if Gerrit is |
| 186 | being used for code reviews. |
| 187 | |
| 188 | Attribute `path`: An optional path relative to the top directory |
| 189 | of the repo client where the Git working directory for this project |
| 190 | should be placed. If not supplied the project name is used. |
Che-Liang Chiou | b2bd91c | 2012-01-11 11:28:42 +0800 | [diff] [blame] | 191 | If the project has a parent element, its path will be prefixed |
| 192 | by the parent's. |
Shawn O. Pearce | 3e54819 | 2008-11-04 11:19:36 -0800 | [diff] [blame] | 193 | |
| 194 | Attribute `remote`: Name of a previously defined remote element. |
| 195 | If not supplied the remote given by the default element is used. |
| 196 | |
| 197 | Attribute `revision`: Name of the Git branch the manifest wants |
| 198 | to track for this project. Names can be relative to refs/heads |
| 199 | (e.g. just "master") or absolute (e.g. "refs/heads/master"). |
| 200 | Tags and/or explicit SHA-1s should work in theory, but have not |
| 201 | been extensively tested. If not supplied the revision given by |
| 202 | the default element is used. |
| 203 | |
Colin Cross | 5acde75 | 2012-03-28 20:15:45 -0700 | [diff] [blame] | 204 | Attribute `groups`: List of groups to which this project belongs, |
Conley Owens | 971de8e | 2012-04-16 10:36:08 -0700 | [diff] [blame] | 205 | whitespace or comma separated. All projects belong to the group |
Conley Owens | bb1b5f5 | 2012-08-13 13:11:18 -0700 | [diff] [blame] | 206 | "all", and each project automatically belongs to a group of |
| 207 | its name:`name` and path:`path`. E.g. for |
Brian Harring | 7da1314 | 2012-06-15 02:24:20 -0700 | [diff] [blame] | 208 | <project name="monkeys" path="barrel-of"/>, that project |
| 209 | definition is implicitly in the following manifest groups: |
Conley Owens | bb1b5f5 | 2012-08-13 13:11:18 -0700 | [diff] [blame] | 210 | default, name:monkeys, and path:barrel-of. If you place a project in the |
| 211 | group "notdefault", it will not be automatically downloaded by repo. |
Che-Liang Chiou | b2bd91c | 2012-01-11 11:28:42 +0800 | [diff] [blame] | 212 | If the project has a parent element, the `name` and `path` here |
| 213 | are the prefixed ones. |
Colin Cross | 5acde75 | 2012-03-28 20:15:45 -0700 | [diff] [blame] | 214 | |
David Pursehouse | 4e46520 | 2012-11-27 22:20:10 +0900 | [diff] [blame^] | 215 | Attribute `sync_c`: Set to true to only sync the given Git |
| 216 | branch (specified in the `revision` attribute) rather than the |
| 217 | whole ref space. |
| 218 | |
| 219 | Attribute `sync_s`: Set to true to also sync sub-projects. |
| 220 | |
| 221 | Attribute `upstream`: Name of the Git branch in which a sha1 |
| 222 | can be found. Used when syncing a revision locked manifest in |
| 223 | -c mode to avoid having to sync the entire ref space. |
| 224 | |
James W. Mills | 24c1308 | 2012-04-12 15:04:13 -0500 | [diff] [blame] | 225 | Element annotation |
| 226 | ------------------ |
| 227 | |
| 228 | Zero or more annotation elements may be specified as children of a |
| 229 | project element. Each element describes a name-value pair that will be |
| 230 | exported into each project's environment during a 'forall' command, |
| 231 | prefixed with REPO__. In addition, there is an optional attribute |
| 232 | "keep" which accepts the case insensitive values "true" (default) or |
| 233 | "false". This attribute determines whether or not the annotation will |
| 234 | be kept when exported with the manifest subcommand. |
| 235 | |
Shawn O. Pearce | 03eaf07 | 2008-11-20 11:42:22 -0800 | [diff] [blame] | 236 | Element remove-project |
| 237 | ---------------------- |
| 238 | |
| 239 | Deletes the named project from the internal manifest table, possibly |
| 240 | allowing a subsequent project element in the same manifest file to |
| 241 | replace the project with a different source. |
| 242 | |
David Pursehouse | b1525bf | 2012-11-14 08:51:38 +0900 | [diff] [blame] | 243 | This element is mostly useful in a local manifest file, where |
Shawn O. Pearce | 03eaf07 | 2008-11-20 11:42:22 -0800 | [diff] [blame] | 244 | the user can remove a project, and possibly replace it with their |
| 245 | own definition. |
| 246 | |
Brian Harring | 2644874 | 2011-04-28 05:04:41 -0700 | [diff] [blame] | 247 | Element include |
| 248 | --------------- |
| 249 | |
| 250 | This element provides the capability of including another manifest |
| 251 | file into the originating manifest. Normal rules apply for the |
David Pursehouse | 9f3406e | 2012-11-14 08:52:25 +0900 | [diff] [blame] | 252 | target manifest to include - it must be a usable manifest on its own. |
Brian Harring | 2644874 | 2011-04-28 05:04:41 -0700 | [diff] [blame] | 253 | |
David Pursehouse | 9f3406e | 2012-11-14 08:52:25 +0900 | [diff] [blame] | 254 | Attribute `name`: the manifest to include, specified relative to |
| 255 | the manifest repository's root. |
Brian Harring | 2644874 | 2011-04-28 05:04:41 -0700 | [diff] [blame] | 256 | |
Shawn O. Pearce | 03eaf07 | 2008-11-20 11:42:22 -0800 | [diff] [blame] | 257 | |
David Pursehouse | 2d5a0df | 2012-11-13 02:50:36 +0900 | [diff] [blame] | 258 | Local Manifests |
| 259 | =============== |
Shawn O. Pearce | 70cd4ab | 2008-11-06 08:48:44 -0800 | [diff] [blame] | 260 | |
David Pursehouse | 2d5a0df | 2012-11-13 02:50:36 +0900 | [diff] [blame] | 261 | Additional remotes and projects may be added through local manifest |
| 262 | files stored in `$TOP_DIR/.repo/local_manifests/*.xml`. |
Shawn O. Pearce | 70cd4ab | 2008-11-06 08:48:44 -0800 | [diff] [blame] | 263 | |
| 264 | For example: |
| 265 | |
David Pursehouse | 2d5a0df | 2012-11-13 02:50:36 +0900 | [diff] [blame] | 266 | $ ls .repo/local_manifests |
| 267 | local_manifest.xml |
| 268 | another_local_manifest.xml |
| 269 | |
| 270 | $ cat .repo/local_manifests/local_manifest.xml |
Shawn O. Pearce | 43c3d9e | 2009-03-04 14:26:50 -0800 | [diff] [blame] | 271 | <?xml version="1.0" encoding="UTF-8"?> |
| 272 | <manifest> |
| 273 | <project path="manifest" |
| 274 | name="tools/manifest" /> |
| 275 | <project path="platform-manifest" |
| 276 | name="platform/manifest" /> |
| 277 | </manifest> |
Shawn O. Pearce | 70cd4ab | 2008-11-06 08:48:44 -0800 | [diff] [blame] | 278 | |
David Pursehouse | 2d5a0df | 2012-11-13 02:50:36 +0900 | [diff] [blame] | 279 | Users may add projects to the local manifest(s) prior to a `repo sync` |
Shawn O. Pearce | 70cd4ab | 2008-11-06 08:48:44 -0800 | [diff] [blame] | 280 | invocation, instructing repo to automatically download and manage |
| 281 | these extra projects. |
David Pursehouse | 2d5a0df | 2012-11-13 02:50:36 +0900 | [diff] [blame] | 282 | |
David Pursehouse | 52f1e5d | 2012-11-14 04:53:24 +0900 | [diff] [blame] | 283 | Manifest files stored in `$TOP_DIR/.repo/local_manifests/*.xml` will |
| 284 | be loaded in alphabetical order. |
| 285 | |
David Pursehouse | 2d5a0df | 2012-11-13 02:50:36 +0900 | [diff] [blame] | 286 | Additional remotes and projects may also be added through a local |
David Pursehouse | 5566ae5 | 2012-11-13 03:04:18 +0900 | [diff] [blame] | 287 | manifest, stored in `$TOP_DIR/.repo/local_manifest.xml`. This method |
| 288 | is deprecated in favor of using multiple manifest files as mentioned |
| 289 | above. |
David Pursehouse | 52f1e5d | 2012-11-14 04:53:24 +0900 | [diff] [blame] | 290 | |
| 291 | If `$TOP_DIR/.repo/local_manifest.xml` exists, it will be loaded before |
| 292 | any manifest files stored in `$TOP_DIR/.repo/local_manifests/*.xml`. |