builder: release-mozilla-release-firefox-macosx64_partner_repacks slave: bld-lion-r5-004 starttime: 1501805387.61 results: exception (4) revision: 9e30e915f1325f041d01c722bd640300f32dc9c3 ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:47.615059) ========= master: http://buildbot-master82.bb.releng.scl3.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:47.615916) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:47.616199) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:47.910475) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:47.910869) ========= bash -c 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py' in dir /builds/slave/rel-m-rel-fx-m64_pner_rpks-000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py'] environment: Apple_PubSub_Socket_Render=/tmp/launch-GsoDyc/Render DISPLAY=/tmp/launch-oje4K8/org.x:0 GIT_SHARE_BASE_DIR=/builds/git-shared HG_SHARE_BASE_DIR=/builds/hg-shared HOME=/Users/cltbld IDLEIZER_DISABLE_SHUTDOWN=true LOGNAME=cltbld PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11 PWD=/builds/slave/rel-m-rel-fx-m64_pner_rpks-000 RUNNER_CONFIG_CMD=/opt/runner/bin/python2.7 /opt/runner/bin/runner -c /opt/runner/runner.cfg SHELL=/bin/bash SSH_AUTH_SOCK=/tmp/launch-L7gz80/Listeners TMPDIR=/var/folders/df/t6wcfhh931l2d4__mmc_s1x800000w/T/ TWISTD_LOG_PATH=/builds/slave/twistd.log USER=cltbld VERSIONER_PYTHON_PREFER_32_BIT=no VERSIONER_PYTHON_VERSION=2.7 __CF_USER_TEXT_ENCODING=0x1C:0:0 using PTY: False --2017-08-03 17:09:47-- https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py Resolving hg.mozilla.org... 63.245.215.102, 63.245.215.25 Connecting to hg.mozilla.org|63.245.215.102|:443... connected. HTTP request sent, awaiting response... 200 Script output follows Length: 12179 (12K) [text/x-python] Saving to: 'archiver_client.py' 0K .......... . 100% 6.69M=0.002s 2017-08-03 17:09:48 (6.69 MB/s) - 'archiver_client.py' saved [12179/12179] program finished with exit code 0 elapsedTime=0.594207 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:48.517791) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:48.518131) ========= rm -rf scripts properties in dir /builds/slave/rel-m-rel-fx-m64_pner_rpks-000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: Apple_PubSub_Socket_Render=/tmp/launch-GsoDyc/Render DISPLAY=/tmp/launch-oje4K8/org.x:0 GIT_SHARE_BASE_DIR=/builds/git-shared HG_SHARE_BASE_DIR=/builds/hg-shared HOME=/Users/cltbld IDLEIZER_DISABLE_SHUTDOWN=true LOGNAME=cltbld PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11 PWD=/builds/slave/rel-m-rel-fx-m64_pner_rpks-000 RUNNER_CONFIG_CMD=/opt/runner/bin/python2.7 /opt/runner/bin/runner -c /opt/runner/runner.cfg SHELL=/bin/bash SSH_AUTH_SOCK=/tmp/launch-L7gz80/Listeners TMPDIR=/var/folders/df/t6wcfhh931l2d4__mmc_s1x800000w/T/ TWISTD_LOG_PATH=/builds/slave/twistd.log USER=cltbld VERSIONER_PYTHON_PREFER_32_BIT=no VERSIONER_PYTHON_VERSION=2.7 __CF_USER_TEXT_ENCODING=0x1C:0:0 using PTY: False program finished with exit code 0 elapsedTime=0.006170 ========= master_lag: 0.05 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:48.570106) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:48.570455) ========= bash -c 'python archiver_client.py mozharness --repo releases/mozilla-release --rev 9e30e915f1325f041d01c722bd640300f32dc9c3 --destination scripts --debug' in dir /builds/slave/rel-m-rel-fx-m64_pner_rpks-000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', u'python archiver_client.py mozharness --repo releases/mozilla-release --rev 9e30e915f1325f041d01c722bd640300f32dc9c3 --destination scripts --debug'] environment: Apple_PubSub_Socket_Render=/tmp/launch-GsoDyc/Render DISPLAY=/tmp/launch-oje4K8/org.x:0 GIT_SHARE_BASE_DIR=/builds/git-shared HG_SHARE_BASE_DIR=/builds/hg-shared HOME=/Users/cltbld IDLEIZER_DISABLE_SHUTDOWN=true LOGNAME=cltbld PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11 PWD=/builds/slave/rel-m-rel-fx-m64_pner_rpks-000 RUNNER_CONFIG_CMD=/opt/runner/bin/python2.7 /opt/runner/bin/runner -c /opt/runner/runner.cfg SHELL=/bin/bash SSH_AUTH_SOCK=/tmp/launch-L7gz80/Listeners TMPDIR=/var/folders/df/t6wcfhh931l2d4__mmc_s1x800000w/T/ TWISTD_LOG_PATH=/builds/slave/twistd.log USER=cltbld VERSIONER_PYTHON_PREFER_32_BIT=no VERSIONER_PYTHON_VERSION=2.7 __CF_USER_TEXT_ENCODING=0x1C:0:0 using PTY: False 2017-08-03 17:09:48,830 truncating revision to first 12 chars 2017-08-03 17:09:48,830 Setting DEBUG logging. 2017-08-03 17:09:48,830 attempt 1/10 2017-08-03 17:09:48,830 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/releases/mozilla-release/9e30e915f132?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2017-08-03 17:09:49,353 unpacking tar archive at: mozilla-release-9e30e915f132/testing/mozharness/ program finished with exit code 0 elapsedTime=0.953333 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:49.536439) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:49.536863) ========= script_repo_revision: 9e30e915f1325f041d01c722bd640300f32dc9c3 ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:49.537897) ========= ========= Started remove old nonce (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:49.538256) ========= rm -f nonce in dir /builds/slave/rel-m-rel-fx-m64_pner_rpks-000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'nonce'] environment: Apple_PubSub_Socket_Render=/tmp/launch-GsoDyc/Render DISPLAY=/tmp/launch-oje4K8/org.x:0 GIT_SHARE_BASE_DIR=/builds/git-shared HG_SHARE_BASE_DIR=/builds/hg-shared HOME=/Users/cltbld IDLEIZER_DISABLE_SHUTDOWN=true LOGNAME=cltbld PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11 PWD=/builds/slave/rel-m-rel-fx-m64_pner_rpks-000 RUNNER_CONFIG_CMD=/opt/runner/bin/python2.7 /opt/runner/bin/runner -c /opt/runner/runner.cfg SHELL=/bin/bash SSH_AUTH_SOCK=/tmp/launch-L7gz80/Listeners TMPDIR=/var/folders/df/t6wcfhh931l2d4__mmc_s1x800000w/T/ TWISTD_LOG_PATH=/builds/slave/twistd.log USER=cltbld VERSIONER_PYTHON_PREFER_32_BIT=no VERSIONER_PYTHON_VERSION=2.7 __CF_USER_TEXT_ENCODING=0x1C:0:0 using PTY: False program finished with exit code 0 elapsedTime=0.006194 ========= master_lag: 0.05 ========= ========= Finished remove old nonce (results: 0, elapsed: 0 secs) (at 2017-08-03 17:09:49.591178) ========= ========= Started download_token exception (results: 4, elapsed: 45 mins, 0 secs) (at 2017-08-03 17:09:49.591489) ========= Slave: bld-lion-r5-004 IP: 10.26.52.24 Duration: 25200 URI: https://mac-v2-signing1.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing1.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing1.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing1.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing1.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing7.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing7.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing7.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing7.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing7.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing6.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing3.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing3.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing3.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing3.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing3.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing4.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing5.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing5.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing5.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing5.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://signing5.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing2.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing2.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing2.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing2.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')] URI: https://mac-v2-signing2.srv.releng.scl3.mozilla.com:9120/token : token generation failed, error message: [('SSL routines', 'SSL3_GET_SERVER_CERTIFICATE', 'certificate verify failed')]

<type 'exceptions.Exception'>: No more signing servers to try.

<type 'exceptions.Exception'>: No more signing servers to try.

Traceback (most recent call last): Failure: exceptions.Exception: No more signing servers to try. ========= Finished download_token exception (results: 4, elapsed: 45 mins, 0 secs) (at 2017-08-03 17:54:49.881883) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Skipped (results: not started, elapsed: not started) ========= ========= Started no change (results: 0, elapsed: 0 secs) (at 2017-08-03 17:54:49.882779) ========= bash -c 'for file in `ls -1`; do cat $file; done' in dir /builds/slave/rel-m-rel-fx-m64_pner_rpks-000/properties (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'for file in `ls -1`; do cat $file; done'] environment: Apple_PubSub_Socket_Render=/tmp/launch-GsoDyc/Render DISPLAY=/tmp/launch-oje4K8/org.x:0 GIT_SHARE_BASE_DIR=/builds/git-shared HG_SHARE_BASE_DIR=/builds/hg-shared HOME=/Users/cltbld IDLEIZER_DISABLE_SHUTDOWN=true LOGNAME=cltbld PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/bin/X11 PWD=/builds/slave/rel-m-rel-fx-m64_pner_rpks-000/properties RUNNER_CONFIG_CMD=/opt/runner/bin/python2.7 /opt/runner/bin/runner -c /opt/runner/runner.cfg SHELL=/bin/bash SSH_AUTH_SOCK=/tmp/launch-L7gz80/Listeners TMPDIR=/var/folders/df/t6wcfhh931l2d4__mmc_s1x800000w/T/ TWISTD_LOG_PATH=/builds/slave/twistd.log USER=cltbld VERSIONER_PYTHON_PREFER_32_BIT=no VERSIONER_PYTHON_VERSION=2.7 __CF_USER_TEXT_ENCODING=0x1C:0:0 using PTY: False program finished with exit code 0 elapsedTime=0.009120 ========= master_lag: 0.05 ========= ========= Finished no change (results: 0, elapsed: 0 secs) (at 2017-08-03 17:54:49.937679) ========= ========= Started reboot skipped (results: 3, elapsed: 0 secs) (at 2017-08-03 17:54:49.938035) ========= ========= Finished reboot skipped (results: 3, elapsed: 0 secs) (at 2017-08-03 17:54:49.938333) ========= ========= Total master_lag: 0.16 =========