commit c788ad0086f7be6bd9642e7519de904b45d86cc6
author David James <davidjames@google.com> Wed Apr 09 13:50:14 2014 -0700
committer chrome-internal-fetch <chrome-internal-fetch@google.com> Fri Apr 11 03:59:36 2014 +0000
tree 3776456121af0e7c8db0bb0889dad57394e9f27f
parent b5e1ae827ba1aea41a66913e89fe448640ab2ccd

Disable parallel downloads for binpkgs.

The gsutil -m feature does not speed up downloads currently, but
increases our memory usage per gsutil instance from ~110MB to ~250MB.
Disable it for now for binpkgs (we do a ton of those in parallel and
they can easily use up all of our memory, even 128GB).

BUG=chromium:361740
TEST=Trybot run. Notice less memory usage.

Change-Id: I036087cf391f64f71cf6b0d786c0a4c935f46502
Reviewed-on: https://chromium-review.googlesource.com/193868
Reviewed-by: Yu-Ju Hong <yjhong@chromium.org>
Tested-by: David James <davidjames@chromium.org>
Commit-Queue: David James <davidjames@chromium.org>

scripts/gs_fetch_binpkg.py

diff --git a/scripts/gs_fetch_binpkg.py b/scripts/gs_fetch_binpkg.py
index 372ce37..998c737 100644
--- a/scripts/gs_fetch_binpkg.py
+++ b/scripts/gs_fetch_binpkg.py
@@ -34,7 +34,7 @@
   temp_path = '%s.tmp' % filename
   osutils.SafeUnlink(temp_path)
   try:
-    ctx.Copy(uri, temp_path, log_output=True)
+    ctx.Copy(uri, temp_path, parallel=False, log_output=True)
     shutil.move(temp_path, filename)
   finally:
     osutils.SafeUnlink(temp_path)