Commit Graph

26 Commits

Author SHA1 Message Date
Scott Lobdell
ff697a3f3a Remove security vulnerability
Bug: 193812251
Change-Id: I891cbf808791696566b01115e997cc29cba3e3e8
2021-08-02 19:31:45 +00:00
Yo Chiang
9e4a1bad45 repo_diff: workspace mustn't be in existing tree
Check that |workspace| is not a sub-directory of an Android tree, so
that we don't `repo init` to a directory outside of |workspace|.

Test: mkdir /tmp/test && cd /tmp/test && repo init [AOSP]
Test: ./repo_diff_android.py  # Should fail to repo-init
Test: rm -rf .repo/ && ./repo_diff_android.py  # Should success
Change-Id: I3e1b94e8e3664cc50ab790aaa7e27b2a8d3feef0
2020-04-23 17:53:47 +08:00
Scott Lobdell
ceb0b6a273 Complete functionality to add the first seen timestamp to non-upstreamed
commits

Test: Unit tests included, running locally
Change-Id: I0b2fd022a37c2d35ee46127ae17a06bf66580500
2018-05-14 14:26:32 -07:00
Scott Lobdell
849e760f01 Merge "Adding query to find the first occurrence of seeing a commit" 2018-05-03 20:13:08 +00:00
Scott Lobdell
6779d3a5e7 Adding query to find the first occurrence of seeing a commit
Test: Unit tests included
Change-Id: If6e3cc70c65a8b179cb315cbfc95d300c92649d7
2018-05-02 09:03:48 -07:00
Scott Lobdell
dbbd386111 Add command-line functionality for versatile usage of repodiff service.
Reporting is another use case that should be satisfied by this tool.
Since the use case deviates in terms of I/O, it's worth adding a
command-line interface for now and for future expansion.

Test: Unit tests included, will validate locally
Change-Id: Ifade560d9898722fdd5299d06899265b70ce771f
2018-05-02 08:56:48 -07:00
Scott Lobdell
545c2ae271 Merge "Bugfix for unicode characters in commit message" 2018-04-30 20:48:35 +00:00
Scott Lobdell
ed2b3e1565 Bugfix for unicode characters in commit message
Test: Regression tests included

Change-Id: I92d4bc0a2962d8dd9d9a3c6fde53d7fbd37891e2
2018-04-30 12:48:45 -07:00
Scott Lobdell
e294207af6 Update project scripts for correct bootstrapping and GCE deployment
Test: Started from an empty environment and cleaned up bootstrap
commands again

Change-Id: I455fdb883240aed952b6a59a38f247bc5a1e8095
2018-04-30 11:23:31 -07:00
Scott Lobdell
4890f21039 Update bootstrap commands
Had some trouble installing this on David's machine the other day, so
updating these commands so that it's seamless.

Test: Ran locally on my machine

Change-Id: I73f7e3b35d6b31ac8746a6d5bf8d59db50abbe2d
2018-04-19 15:42:21 -07:00
Scott Lobdell
2ae0967762 Merge "Update behavior of commits not upstreamed to include pure deletions" am: 97bd347fcf am: 64a6611cd4
am: 85a2507932

Change-Id: Id8035630140f34cdf8f5d779935be7fe92e442b4
2018-04-19 14:19:14 -07:00
Scott Lobdell
85a2507932 Merge "Update behavior of commits not upstreamed to include pure deletions" am: 97bd347fcf
am: 64a6611cd4

Change-Id: I95b4ed47ab4f671a05803e398bc234d1bf9d6b9e
2018-04-19 14:06:14 -07:00
Scott Lobdell
742553e5f7 Update behavior of commits not upstreamed to include pure deletions
Test: No existing test coverage, will test locally against case
Bug: 77971800

Change-Id: I71f13a07a3fbbcaaa4f8535f10f92f142a8a761a
2018-04-19 20:35:25 +00:00
Scott Lobdell
9a38910900 Add project type to database records
Test: No production impact, unit tests included, actively testing
current production dataset

Change-Id: Ia7835938d602f3a11e0d001a1242a8278960b096
2018-04-16 09:49:45 -07:00
Scott Lobdell
85fa8b69e7 Add Tech area view
Test: Unit tests in place, visualization is already updated with tech
area

Change-Id: Ib9114f93c2fbed42565f5672048f331722ee5b47
2018-04-13 14:07:16 -07:00
Scott Lobdell
f7f3db493c Dockerize for deployment
Test: Still in bootstrapping phase; tested a deployment from local
machine, can hit public facing endpoint

Change-Id: Ie194ec7e61a2ef84a3b74a22a52348a81a753d89
2018-04-02 14:48:56 -07:00
Scott Lobdell
96629bd335 Base commit for service layer for repo diff tooling
Test: Changes are currently independent of the rest of this project. Tests can
currently manually be run with "make test". CL is large, but poses no
risk

Change-Id: Ia77e073df077257cab96b7ca4e1d99a900d029b2
2018-03-06 13:38:05 -08:00
Scott Lobdell
300c54efb4 Parallelize diffing of projects
Test: ./android/development/tools/repo_diff/repo_diff_android.py -u persistent-https://googleplex-android.git.corp.google.com/platform/manifest -b “master-security-release” -r persistent-https://googleplex-android.git.corp.google.com/platform/manifest -a “master”
Change-Id: I55b1cddf81cb8d1f5c6427ee2e131c7a766b36cf
2018-02-06 10:20:23 -08:00
Po-Chien Hsueh
79a7b0e8f4 Check project path to make sure it actully exists
Some old projects might be removed for some reason, especially
the downstream ones. It should be fine to just skip analysing them
because people have stopped working on them.

Test: run the script against an old release
Change-Id: I563905565c4c502036159fce6a386bba13ba25ea
2017-09-28 17:15:08 +08:00
Po-Chien Hsueh
95ca7ccb84 Add option --ignore_error_during_sync
Some old SHA1 might be invalid when we use this tool.
Ignore these projects and keep going on.

Test: run the script against an old release
Change-Id: I5c89911759de6d122052e841eef0b016fa8b1422
2017-09-28 16:55:31 +08:00
Po-Chien Hsueh
f9b8f0cce0 Write results to subfolders
We are using this tools on multiple releases (tags).
Create subfolders using release names, so that results won't be
overwitten.

Test: run the script against multiple releases
Change-Id: I9a94940d630874a5b378431f20a6c1182cf11509
2017-09-28 16:55:31 +08:00
Po-Chien Hsueh
fb4ba49c20 Rename exclusions.txt in the script
The file name has been changed in a previous CL

Test: run the script
Change-Id: I7cc1b183989ae674e14e65321e09c51d5c689ad0
2017-09-28 16:55:31 +08:00
Diego Wilson
7514722144 Add README.md
Add a document explaining how to create a data studio dashboard using
the repo diff tool.

Renamed repo_diff_downstream.py to repo_diff_trees.py.

Renamed exclusions.txt to android_exclusions.txt.
2017-09-27 11:19:58 -07:00
Diego Wilson
190a725b60 repo_diff: sync tip of branches of no tag is given
Not all Android source trees support build IDs and tags.
When no build tag is requested, rather than try to match
the build IDs just sync the branch tips of the upstream
and downstream source trees.

Also select two Android Oreo release candidates
as the default branches. The fact that there are frozen
branches and that the diff is small serve as a good showcase
of the tool.

Change-Id: Ifdefd79fb6b32c6b83e0aee390dd5a435b6a61fc
2017-09-14 15:56:54 -07:00
Diego Wilson
dbb1b8d8ef Rename repo_diff_android.py workspace directories
Renamed the upstream and downstream workspaces to
"upstream" and "downstream", respectively.

Change-Id: I28efd32a4fa4c05410940061c18bb463132d9450
2017-09-11 11:10:22 -07:00
Diego Wilson
61fb65ce4c Add repo_diff tools
These tools help compare android repo workspaces for high level
analysis.

Test: Run python repo_diff/repo_diff_android.py
Change-Id: I645351521c7f61735d3ce65a93569983cd28851c
2017-09-07 17:44:35 -04:00