builder: release-mozilla-release-fennec_bouncer_submitter slave: bld-linux64-spot-072 starttime: 1484656831.29 results: success (0) buildid: 20170117044027 builduid: b6955b21c8f74ec8bf8a9b8170b46f54 ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2017-01-17 04:40:31.287021) ========= master: http://buildbot-master77.bb.releng.use1.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2017-01-17 04:40:31.287556) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2017-01-17 04:40:31.287856) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2017-01-17 04:40:31.908638) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2017-01-17 04:40:31.908962) ========= bash -c 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py' in dir /builds/slave/rel-m-rel-bncr_sub-00000000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-072.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-rel-bncr_sub-00000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False --2017-01-17 04:40:31-- https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py Resolving hg.mozilla.org... 63.245.215.25, 63.245.215.102 Connecting to hg.mozilla.org|63.245.215.25|:443... connected. HTTP request sent, awaiting response... 200 Script output follows Length: 12179 (12K) [text/x-python] Saving to: ‘archiver_client.py’ 0K .......... . 100% 161K=0.07s 2017-01-17 04:40:32 (161 KB/s) - ‘archiver_client.py’ saved [12179/12179] program finished with exit code 0 elapsedTime=0.589185 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2017-01-17 04:40:32.509681) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2017-01-17 04:40:32.509990) ========= rm -rf scripts properties in dir /builds/slave/rel-m-rel-bncr_sub-00000000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-072.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-rel-bncr_sub-00000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002427 ========= master_lag: 0.05 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2017-01-17 04:40:32.557473) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 2 mins, 3 secs) (at 2017-01-17 04:40:32.557803) ========= bash -c 'python archiver_client.py mozharness --repo releases/mozilla-release --tag FENNEC_51_0_RELEASE --destination scripts --debug' in dir /builds/slave/rel-m-rel-bncr_sub-00000000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'python archiver_client.py mozharness --repo releases/mozilla-release --tag FENNEC_51_0_RELEASE --destination scripts --debug'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-072.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-rel-bncr_sub-00000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 2017-01-17 04:40:32,593 Setting DEBUG logging. 2017-01-17 04:40:32,593 "FENNEC_51_0_RELEASE" was passed as the tag. Querying remote repository for corresponding rev hash. warning: connecting to hg.mozilla.org using legacy security technology (TLS 1.0); see https://mercurial-scm.org/wiki/SecureConnections for more info 2017-01-17 04:40:33,669 revision being used: 792e280b5c36 2017-01-17 04:40:33,669 attempt 1/10 2017-01-17 04:40:33,670 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/releases/mozilla-release/792e280b5c36?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2017-01-17 04:40:35,004 attempt 1/10 2017-01-17 04:40:35,606 current task status: no status available at this point. state: PENDING 2017-01-17 04:40:35,606 sleeping for 9.00s (attempt 1/10) 2017-01-17 04:40:44,615 attempt 2/10 2017-01-17 04:40:45,230 current task status: no status available at this point. state: PENDING 2017-01-17 04:40:45,231 sleeping for 13.50s (attempt 2/10) 2017-01-17 04:40:58,744 attempt 3/10 2017-01-17 04:40:59,378 current task status: no status available at this point. state: PENDING 2017-01-17 04:40:59,378 sleeping for 19.25s (attempt 3/10) 2017-01-17 04:41:18,648 attempt 4/10 2017-01-17 04:41:19,269 current task status: no status available at this point. state: PENDING 2017-01-17 04:41:19,269 sleeping for 29.88s (attempt 4/10) 2017-01-17 04:41:49,174 attempt 5/10 2017-01-17 04:41:49,818 current task status: Task has expired from pending for too long. Re-creating task. state: RETRY 2017-01-17 04:41:49,818 sleeping for 44.81s (attempt 5/10) 2017-01-17 04:42:34,676 attempt 6/10 2017-01-17 04:42:35,107 current task status: Task completed! Check 's3_urls' for upload locations. state: SUCCESS 2017-01-17 04:42:35,843 unpacking tar archive at: mozilla-release-792e280b5c36/testing/mozharness/ program finished with exit code 0 elapsedTime=123.936098 ========= master_lag: 0.00 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 2 mins, 3 secs) (at 2017-01-17 04:42:36.497935) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2017-01-17 04:42:36.498260) ========= script_repo_revision: FENNEC_51_0_RELEASE ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2017-01-17 04:42:36.498868) ========= ========= Started downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2017-01-17 04:42:36.499150) ========= ========= Finished downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2017-01-17 04:42:36.507566) ========= ========= Started 'scripts/scripts/bouncer_submitter.py -c ...' (results: 0, elapsed: 3 secs) (at 2017-01-17 04:42:36.507864) ========= scripts/scripts/bouncer_submitter.py -c releases/bouncer_fennec.py --revision FENNEC_51_0_RELEASE --repo releases/mozilla-release --version 51.0 --credentials-file oauth.txt --bouncer-api-prefix https://bounceradmin.mozilla.com/api --build-number 1 in dir /builds/slave/rel-m-rel-bncr_sub-00000000000/. (timeout 1200 secs) watching logfiles {} argv: ['scripts/scripts/bouncer_submitter.py', '-c', 'releases/bouncer_fennec.py', '--revision', 'FENNEC_51_0_RELEASE', '--repo', 'releases/mozilla-release', '--version', '51.0', '--credentials-file', 'oauth.txt', '--bouncer-api-prefix', 'https://bounceradmin.mozilla.com/api', '--build-number', '1'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-072.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PROPERTIES_FILE=/builds/slave/rel-m-rel-bncr_sub-00000000000/buildprops.json PWD=/builds/slave/rel-m-rel-bncr_sub-00000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 04:42:36 INFO - MultiFileLogger online at 20170117 04:42:36 in /builds/slave/rel-m-rel-bncr_sub-00000000000 04:42:36 INFO - Using buildbot properties: 04:42:36 INFO - { 04:42:36 INFO - "project": "", 04:42:36 INFO - "product": "Fennec", 04:42:36 INFO - "build_number": 1, 04:42:36 INFO - "scheduler": "release-mozilla-release-fennec_build", 04:42:36 INFO - "repository": "", 04:42:36 INFO - "buildername": "release-mozilla-release-fennec_bouncer_submitter", 04:42:36 INFO - "buildid": "20170117044027", 04:42:36 INFO - "basedir": "/builds/slave/rel-m-rel-bncr_sub-00000000000", 04:42:36 INFO - "release_config": "mozilla/release-fennec-mozilla-release.py", 04:42:36 INFO - "buildnumber": 3, 04:42:36 INFO - "platform": null, 04:42:36 INFO - "version": "51.0", 04:42:36 INFO - "master": "http://buildbot-master77.bb.releng.use1.mozilla.com:8001/", 04:42:36 INFO - "slavebuilddir": "rel-m-rel-bncr_sub-00000000000", 04:42:36 INFO - "branch": "release-mozilla-release", 04:42:36 INFO - "script_repo_revision": "FENNEC_51_0_RELEASE", 04:42:36 INFO - "products": "fennec", 04:42:36 INFO - "slavename": "bld-linux64-spot-072", 04:42:36 INFO - "builduid": "b6955b21c8f74ec8bf8a9b8170b46f54", 04:42:36 INFO - "revision": null 04:42:36 INFO - } 04:42:36 INFO - Run as scripts/scripts/bouncer_submitter.py -c releases/bouncer_fennec.py --revision FENNEC_51_0_RELEASE --repo releases/mozilla-release --version 51.0 --credentials-file oauth.txt --bouncer-api-prefix https://bounceradmin.mozilla.com/api --build-number 1 04:42:36 INFO - Dumping config to /builds/slave/rel-m-rel-bncr_sub-00000000000/logs/localconfig.json. 04:42:36 INFO - {'append_to_log': False, 04:42:36 INFO - 'base_work_dir': '/builds/slave/rel-m-rel-bncr_sub-00000000000', 04:42:36 INFO - 'bouncer-api-prefix': 'https://bounceradmin.mozilla.com/api', 04:42:36 INFO - 'build_number': '1', 04:42:36 INFO - 'buildbot_json_path': 'buildprops.json', 04:42:36 INFO - 'config_files': ('releases/bouncer_fennec.py',), 04:42:36 INFO - 'credentials_file': 'oauth.txt', 04:42:36 INFO - 'log_level': 'info', 04:42:36 INFO - 'log_to_console': True, 04:42:36 INFO - 'opt_config_files': (), 04:42:36 INFO - 'products': {'apk': {'add-locales': False, 04:42:36 INFO - 'alias': 'fennec-latest', 04:42:36 INFO - 'check_uptake': True, 04:42:36 INFO - 'paths': {'android-api-15': {'bouncer-platform': 'android', 04:42:36 INFO - 'path': '/mobile/releases/%(version)s/android-api-15/:lang/fennec-%(version)s.:lang.android-arm.apk'}, 04:42:36 INFO - 'android-x86': {'bouncer-platform': 'android-x86', 04:42:36 INFO - 'path': '/mobile/releases/%(version)s/android-x86/:lang/fennec-%(version)s.:lang.android-i386.apk'}}, 04:42:36 INFO - 'product-name': 'Fennec-%(version)s', 04:42:36 INFO - 'ssl-only': False}}, 04:42:36 INFO - 'repo': 'releases/mozilla-release', 04:42:36 INFO - 'revision': 'FENNEC_51_0_RELEASE', 04:42:36 INFO - 'version': '51.0', 04:42:36 INFO - 'volatile_config': {'actions': None, 'add_actions': None, 'no_actions': None}, 04:42:36 INFO - 'work_dir': 'build'} 04:42:36 INFO - [mozharness: 2017-01-17 12:42:36.613647Z] Running clobber step. 04:42:36 INFO - Running main action method: clobber 04:42:36 INFO - rmtree: /builds/slave/rel-m-rel-bncr_sub-00000000000/build 04:42:36 INFO - [mozharness: 2017-01-17 12:42:36.616716Z] Finished clobber step (success) 04:42:36 INFO - [mozharness: 2017-01-17 12:42:36.617017Z] Running download-shipped-locales step. 04:42:36 INFO - Running main action method: download_shipped_locales 04:42:36 INFO - No need to download shipped-locales 04:42:36 INFO - [mozharness: 2017-01-17 12:42:36.617607Z] Finished download-shipped-locales step (success) 04:42:36 INFO - [mozharness: 2017-01-17 12:42:36.617820Z] Running submit step. 04:42:36 INFO - Running main action method: submit 04:42:36 INFO - Checking if Fennec-51.0 already exists 04:42:36 INFO - retry: Calling _api_call with args: ('product_show?product=Fennec-51.0', None), kwargs: {}, attempt #1 04:42:36 INFO - Submitting to https://bounceradmin.mozilla.com/api/product_show?product=Fennec-51.0 04:42:37 INFO - Server response 04:42:37 INFO - 04:42:37 INFO - Products found: 0 04:42:37 INFO - Adding apk... 04:42:37 INFO - retry: Calling _api_call with args: ('product_add/', {'product': 'Fennec-51.0'}), kwargs: {}, attempt #1 04:42:37 INFO - POST data: product=Fennec-51.0 04:42:37 INFO - Submitting to https://bounceradmin.mozilla.com/api/product_add/ 04:42:38 INFO - Server response 04:42:38 INFO - 04:42:38 INFO - Adding paths... 04:42:38 INFO - android-api-15 (android): /mobile/releases/51.0/android-api-15/:lang/fennec-51.0.:lang.android-arm.apk 04:42:38 INFO - retry: Calling _api_call with args: ('location_add/', {'path': '/mobile/releases/51.0/android-api-15/:lang/fennec-51.0.:lang.android-arm.apk', 'product': 'Fennec-51.0', 'os': 'android'}), kwargs: {}, attempt #1 04:42:38 INFO - POST data: path=%2Fmobile%2Freleases%2F51.0%2Fandroid-api-15%2F%3Alang%2Ffennec-51.0.%3Alang.android-arm.apk&product=Fennec-51.0&os=android 04:42:38 INFO - Submitting to https://bounceradmin.mozilla.com/api/location_add/ 04:42:39 INFO - Server response 04:42:39 INFO - /mobile/releases/51.0/android-api-15/:lang/fennec-51.0.:lang.android-arm.apk 04:42:39 INFO - android-x86 (android-x86): /mobile/releases/51.0/android-x86/:lang/fennec-51.0.:lang.android-i386.apk 04:42:39 INFO - retry: Calling _api_call with args: ('location_add/', {'path': '/mobile/releases/51.0/android-x86/:lang/fennec-51.0.:lang.android-i386.apk', 'product': 'Fennec-51.0', 'os': 'android-x86'}), kwargs: {}, attempt #1 04:42:39 INFO - POST data: path=%2Fmobile%2Freleases%2F51.0%2Fandroid-x86%2F%3Alang%2Ffennec-51.0.%3Alang.android-i386.apk&product=Fennec-51.0&os=android-x86 04:42:39 INFO - Submitting to https://bounceradmin.mozilla.com/api/location_add/ 04:42:40 INFO - Server response 04:42:40 INFO - /mobile/releases/51.0/android-x86/:lang/fennec-51.0.:lang.android-i386.apk 04:42:40 INFO - [mozharness: 2017-01-17 12:42:40.136937Z] Finished submit step (success) 04:42:40 INFO - Running post-run listener: copy_logs_to_upload_dir 04:42:40 INFO - Copying logs to upload dir... 04:42:40 INFO - mkdir: /builds/slave/rel-m-rel-bncr_sub-00000000000/build/upload/logs 04:42:40 INFO - Copying logs to upload dir... program finished with exit code 0 elapsedTime=3.644076 ========= master_lag: 0.01 ========= ========= Finished 'scripts/scripts/bouncer_submitter.py -c ...' (results: 0, elapsed: 3 secs) (at 2017-01-17 04:42:40.162412) ========= ========= Started no change (results: 0, elapsed: 0 secs) (at 2017-01-17 04:42:40.163438) ========= bash -c 'for file in `ls -1`; do cat $file; done' in dir /builds/slave/rel-m-rel-bncr_sub-00000000000/properties (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'for file in `ls -1`; do cat $file; done'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-072.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-rel-bncr_sub-00000000000/properties SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.004686 ========= master_lag: 0.04 ========= ========= Finished no change (results: 0, elapsed: 0 secs) (at 2017-01-17 04:42:40.212143) ========= ========= Started 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2017-01-17 04:42:40.212470) ========= rm -f oauth.txt in dir /builds/slave/rel-m-rel-bncr_sub-00000000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'oauth.txt'] environment: BUILDBOTCUSTOM=https://hg.mozilla.org/build/buildbotcustom BUILDBOT_CONFIGS=https://hg.mozilla.org/build/buildbot-configs CCACHE_HASHDIR= CLOBBERER_URL=https://api.pub.build.mozilla.org/clobberer/forceclobber G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-072.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-rel-bncr_sub-00000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002366 ========= master_lag: 0.05 ========= ========= Finished 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2017-01-17 04:42:40.260409) ========= ========= Total master_lag: 0.16 =========