builder: release-mozilla-beta-firefox_chcksms slave: bld-linux64-spot-420 starttime: 1479180202.47 results: failure (2) revision: f455459b2ae5e42e5fb29d90533095add226ca95 ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:22.472920) ========= master: http://buildbot-master72.bb.releng.usw2.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:22.473340) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:22.473612) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:22.541224) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:22.541490) ========= rm -rf scripts properties in dir /builds/slave/rel-m-beta-fx_chcksms-00000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-420.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fx_chcksms-00000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.003500 ========= master_lag: 0.05 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:22.590116) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 1 secs) (at 2016-11-14 19:23:22.590427) ========= bash -c 'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo releases/mozilla-beta --rev f455459b2ae5e42e5fb29d90533095add226ca95 --destination scripts --debug' in dir /builds/slave/rel-m-beta-fx_chcksms-00000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', u'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo releases/mozilla-beta --rev f455459b2ae5e42e5fb29d90533095add226ca95 --destination scripts --debug'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-420.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fx_chcksms-00000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 2016-11-14 19:23:22,635 truncating revision to first 12 chars 2016-11-14 19:23:22,636 Setting DEBUG logging. 2016-11-14 19:23:22,636 attempt 1/10 2016-11-14 19:23:22,636 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/releases/mozilla-beta/f455459b2ae5?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2016-11-14 19:23:24,046 unpacking tar archive at: mozilla-beta-f455459b2ae5/testing/mozharness/ program finished with exit code 0 elapsedTime=1.572501 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 1 secs) (at 2016-11-14 19:23:24.172209) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:24.172524) ========= script_repo_revision: f455459b2ae5e42e5fb29d90533095add226ca95 ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:24.172908) ========= ========= Started remove old nonce (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:24.173179) ========= rm -f nonce in dir /builds/slave/rel-m-beta-fx_chcksms-00000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'nonce'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-420.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fx_chcksms-00000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.003078 ========= master_lag: 0.04 ========= ========= Finished remove old nonce (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:24.220031) ========= ========= Started downloading to token (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:24.220311) ========= Slave: bld-linux64-spot-420 IP: 10.132.55.75 Duration: 25200 URI: https://signing6.srv.releng.scl3.mozilla.com:9120/token ========= Finished downloading to token (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:24.403030) ========= ========= Started set props: toolsdir (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:24.403415) ========= bash -c pwd in dir /tools/checkouts/build-tools (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'pwd'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-420.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/tools/checkouts/build-tools SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False /tools/checkouts/build-tools program finished with exit code 0 elapsedTime=0.003904 toolsdir: '/tools/checkouts/build-tools' ========= master_lag: 0.04 ========= ========= Finished set props: toolsdir (results: 0, elapsed: 0 secs) (at 2016-11-14 19:23:24.450721) ========= ========= Started '/tools/buildbot/bin/python scripts/scripts/release/generate-checksums.py ...' failed (results: 2, elapsed: 13 mins, 32 secs) (at 2016-11-14 19:23:24.451007) ========= /tools/buildbot/bin/python scripts/scripts/release/generate-checksums.py --stage-product firefox --bucket-name-full net-mozaws-prod-delivery-firefox --credentials /builds/release-s3.credentials --tools-repo /tools/checkouts/build-tools in dir /builds/slave/rel-m-beta-fx_chcksms-00000000/. (timeout 3600 secs) (maxTime 14400 secs) watching logfiles {} argv: ['/tools/buildbot/bin/python', 'scripts/scripts/release/generate-checksums.py', '--stage-product', 'firefox', '--bucket-name-full', 'net-mozaws-prod-delivery-firefox', '--credentials', '/builds/release-s3.credentials', '--tools-repo', '/tools/checkouts/build-tools'] environment: CCACHE_COMPRESS=1 CCACHE_DIR=/builds/ccache CCACHE_HASHDIR= CCACHE_UMASK=002 DISPLAY=:2 G_BROKEN_FILENAMES=1 HG_SHARE_BASE_DIR=/builds/hg-shared HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-420.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LC_ALL=C LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZ_AUTOMATION=1 MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_OBJDIR=obj-firefox MOZ_SIGNING_SERVERS=gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120 MOZ_SIGN_CMD=python /tools/checkouts/build-tools/release/signing/signtool.py --cachedir /builds/slave/rel-m-beta-fx_chcksms-00000000/signing_cache -t /builds/slave/rel-m-beta-fx_chcksms-00000000/token -n /builds/slave/rel-m-beta-fx_chcksms-00000000/nonce -c /tools/checkouts/build-tools/release/signing/host.cert -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120 PATH=/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin PROPERTIES_FILE=/builds/slave/rel-m-beta-fx_chcksms-00000000/buildprops.json PWD=/builds/slave/rel-m-beta-fx_chcksms-00000000 SHELL=/bin/bash SHLVL=1 TERM=linux TINDERBOX_OUTPUT=1 TMOUT=86400 TOOLTOOL_CACHE=/builds/tooltool_cache TOOLTOOL_HOME=/builds USER=cltbld _=/tools/buildbot/bin/python using PTY: False 19:23:24 INFO - MultiFileLogger online at 20161114 19:23:24 in /builds/slave/rel-m-beta-fx_chcksms-00000000 19:23:24 INFO - Using buildbot properties: 19:23:24 INFO - { 19:23:24 INFO - "project": "", 19:23:24 INFO - "product": "firefox", 19:23:24 INFO - "build_number": 1, 19:23:24 INFO - "taskId": "er2SVtaXSGKHKir-85KxQg", 19:23:24 INFO - "repository": "", 19:23:24 INFO - "buildername": "release-mozilla-beta-firefox_chcksms", 19:23:24 INFO - "basedir": "/builds/slave/rel-m-beta-fx_chcksms-00000000", 19:23:24 INFO - "buildnumber": 13, 19:23:24 INFO - "platform": null, 19:23:24 INFO - "version": "51.0b1", 19:23:24 INFO - "release_promotion": true, 19:23:24 INFO - "script_repo_revision": "f455459b2ae5e42e5fb29d90533095add226ca95", 19:23:24 INFO - "branch": "mozilla-beta", 19:23:24 INFO - "master": "http://buildbot-master72.bb.releng.usw2.mozilla.com:8001/", 19:23:24 INFO - "revision": "f455459b2ae5e42e5fb29d90533095add226ca95", 19:23:24 INFO - "slavename": "bld-linux64-spot-420", 19:23:24 INFO - "repo_path": "releases/mozilla-beta" 19:23:24 INFO - } 19:23:24 INFO - Overriding version with 51.0b1 19:23:24 INFO - Overriding build_number with 1 19:23:24 INFO - Run as scripts/scripts/release/generate-checksums.py --stage-product firefox --bucket-name-full net-mozaws-prod-delivery-firefox --credentials /builds/release-s3.credentials --tools-repo /tools/checkouts/build-tools 19:23:24 INFO - Dumping config to /builds/slave/rel-m-beta-fx_chcksms-00000000/logs/localconfig.json. 19:23:24 INFO - {'append_to_log': False, 19:23:24 INFO - 'base_work_dir': '/builds/slave/rel-m-beta-fx_chcksms-00000000', 19:23:24 INFO - 'bucket_name_full': 'net-mozaws-prod-delivery-firefox', 19:23:24 INFO - 'build_number': 1, 19:23:24 INFO - 'buildbot_json_path': 'buildprops.json', 19:23:24 INFO - 'credentials': '/builds/release-s3.credentials', 19:23:24 INFO - 'formats': ('sha512',), 19:23:24 INFO - 'includes': ('^.*\\.tar\\.bz2$', 19:23:24 INFO - '^.*\\.tar\\.xz$', 19:23:24 INFO - '^.*\\.dmg$', 19:23:24 INFO - '^.*\\.bundle$', 19:23:24 INFO - '^.*\\.mar$', 19:23:24 INFO - '^.*Setup.*\\.exe$', 19:23:24 INFO - '^.*\\.xpi$'), 19:23:24 INFO - 'log_level': 'info', 19:23:24 INFO - 'log_to_console': True, 19:23:24 INFO - 'opt_config_files': (), 19:23:24 INFO - 'parallelization': 20, 19:23:24 INFO - 'pip_index': True, 19:23:24 INFO - 'stage_product': 'firefox', 19:23:24 INFO - 'tools_repo': '/tools/checkouts/build-tools', 19:23:24 INFO - 'version': u'51.0b1', 19:23:24 INFO - 'virtualenv_modules': ('boto',), 19:23:24 INFO - 'virtualenv_path': 'venv', 19:23:24 INFO - 'volatile_config': {'actions': None, 'add_actions': None, 'no_actions': None}, 19:23:24 INFO - 'work_dir': 'build'} 19:23:24 INFO - [mozharness: 2016-11-15 03:23:24.614404Z] Running create-virtualenv step. 19:23:24 INFO - Running main action method: create_virtualenv 19:23:24 INFO - Creating virtualenv /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv 19:23:24 INFO - mkdir: /builds/slave/rel-m-beta-fx_chcksms-00000000/build 19:23:24 INFO - Running command: ['virtualenv', '--no-site-packages', '--distribute', '/builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv'] in /builds/slave/rel-m-beta-fx_chcksms-00000000/build 19:23:24 INFO - Copy/paste: virtualenv --no-site-packages --distribute /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv 19:23:24 INFO - The --no-site-packages flag is deprecated; it is now the default behavior. 19:23:24 INFO - New python executable in /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/python2.7 19:23:24 INFO - Also creating executable in /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/python 19:23:25 INFO - Installing distribute.............................................................................................................................................................................................done. 19:23:25 INFO - Installing pip...............done. 19:23:25 INFO - Return code: 0 19:23:25 INFO - Installing boto into virtualenv /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv 19:23:25 INFO - retry: Calling run_command with args: [['/builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pip', 'install', '--timeout', '120', 'boto']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x213ea30>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x1da3768>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x2197bd0>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x2157850>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x2159468>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x2149418>, 'level': 'critical'}], 'cwd': '/builds/slave/rel-m-beta-fx_chcksms-00000000/build', 'env': {'MOZ_AUTOMATION': '1', 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'MOZ_OBJDIR': 'obj-firefox', 'BOTO_CONFIG': '/builds/release-s3.credentials', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'MOZ_SIGNING_SERVERS': 'gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'HOME': '/home/cltbld', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'TINDERBOX_OUTPUT': '1', 'MOZ_SIGN_CMD': 'python /tools/checkouts/build-tools/release/signing/signtool.py --cachedir /builds/slave/rel-m-beta-fx_chcksms-00000000/signing_cache -t /builds/slave/rel-m-beta-fx_chcksms-00000000/token -n /builds/slave/rel-m-beta-fx_chcksms-00000000/nonce -c /tools/checkouts/build-tools/release/signing/host.cert -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 'LC_ALL': 'C', 'TOOLTOOL_HOME': '/builds', '_': '/tools/buildbot/bin/python', 'MAIL': '/var/spool/mail/cltbld', 'HOSTNAME': 'bld-linux64-spot-420.build.releng.usw2.mozilla.com', 'HISTCONTROL': 'ignoredups', 'PWD': '/builds/slave/rel-m-beta-fx_chcksms-00000000', 'PROPERTIES_FILE': '/builds/slave/rel-m-beta-fx_chcksms-00000000/buildprops.json', 'CCACHE_DIR': '/builds/ccache', 'CCACHE_COMPRESS': '1', 'TOOLTOOL_CACHE': '/builds/tooltool_cache'}}, attempt #1 19:23:25 INFO - Running command: ['/builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pip', 'install', '--timeout', '120', 'boto'] in /builds/slave/rel-m-beta-fx_chcksms-00000000/build 19:23:25 INFO - Copy/paste: /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pip install --timeout 120 boto 19:23:25 INFO - Using env: {'BOTO_CONFIG': '/builds/release-s3.credentials', 19:23:25 INFO - 'CCACHE_COMPRESS': '1', 19:23:25 INFO - 'CCACHE_DIR': '/builds/ccache', 19:23:25 INFO - 'CCACHE_HASHDIR': '', 19:23:25 INFO - 'CCACHE_UMASK': '002', 19:23:25 INFO - 'DISPLAY': ':2', 19:23:25 INFO - 'G_BROKEN_FILENAMES': '1', 19:23:25 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 19:23:25 INFO - 'HISTCONTROL': 'ignoredups', 19:23:25 INFO - 'HISTSIZE': '1000', 19:23:25 INFO - 'HOME': '/home/cltbld', 19:23:25 INFO - 'HOSTNAME': 'bld-linux64-spot-420.build.releng.usw2.mozilla.com', 19:23:25 INFO - 'LANG': 'en_US.UTF-8', 19:23:25 INFO - 'LC_ALL': 'C', 19:23:25 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 19:23:25 INFO - 'LOGNAME': 'cltbld', 19:23:25 INFO - 'MAIL': '/var/spool/mail/cltbld', 19:23:25 INFO - 'MOZ_AUTOMATION': '1', 19:23:25 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 19:23:25 INFO - 'MOZ_OBJDIR': 'obj-firefox', 19:23:25 INFO - 'MOZ_SIGNING_SERVERS': 'gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 19:23:25 INFO - 'MOZ_SIGN_CMD': 'python /tools/checkouts/build-tools/release/signing/signtool.py --cachedir /builds/slave/rel-m-beta-fx_chcksms-00000000/signing_cache -t /builds/slave/rel-m-beta-fx_chcksms-00000000/token -n /builds/slave/rel-m-beta-fx_chcksms-00000000/nonce -c /tools/checkouts/build-tools/release/signing/host.cert -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:osslsigncode:signcode:mar:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 19:23:25 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 19:23:25 INFO - 'PROPERTIES_FILE': '/builds/slave/rel-m-beta-fx_chcksms-00000000/buildprops.json', 19:23:25 INFO - 'PWD': '/builds/slave/rel-m-beta-fx_chcksms-00000000', 19:23:25 INFO - 'SHELL': '/bin/bash', 19:23:25 INFO - 'SHLVL': '1', 19:23:25 INFO - 'TERM': 'linux', 19:23:25 INFO - 'TINDERBOX_OUTPUT': '1', 19:23:25 INFO - 'TMOUT': '86400', 19:23:25 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 19:23:25 INFO - 'TOOLTOOL_HOME': '/builds', 19:23:25 INFO - 'USER': 'cltbld', 19:23:25 INFO - '_': '/tools/buildbot/bin/python'} 19:23:28 INFO - Ignoring indexes: http://pypi.python.org/simple/ 19:23:28 INFO - Downloading/unpacking boto 19:23:28 INFO - Running setup.py egg_info for package boto 19:23:28 INFO - warning: no files found matching 'boto/mturk/test/*.doctest' 19:23:28 INFO - warning: no files found matching 'boto/mturk/test/.gitignore' 19:23:28 INFO - Installing collected packages: boto 19:23:28 INFO - Running setup.py install for boto 19:23:28 INFO - warning: no files found matching 'boto/mturk/test/*.doctest' 19:23:28 INFO - warning: no files found matching 'boto/mturk/test/.gitignore' 19:23:28 INFO - changing mode of build/scripts-2.7/sdbadmin from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/elbadmin from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/cfadmin from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/s3put from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/fetch_file from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/launch_instance from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/list_instances from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/taskadmin from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/kill_instance from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/bundle_image from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/pyami_sendmail from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/lss3 from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/cq from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/route53 from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/cwutil from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/instance_events from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/asadmin from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/glacier from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/mturk from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/dynamodb_dump from 664 to 775 19:23:28 INFO - changing mode of build/scripts-2.7/dynamodb_load from 664 to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/cfadmin to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/sdbadmin to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/launch_instance to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/route53 to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/list_instances to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/dynamodb_load to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/cq to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/cwutil to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/s3put to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/dynamodb_dump to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/kill_instance to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/bundle_image to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/fetch_file to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/mturk to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/asadmin to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pyami_sendmail to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/lss3 to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/glacier to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/taskadmin to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/elbadmin to 775 19:23:28 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/instance_events to 775 19:23:28 INFO - Successfully installed boto 19:23:28 INFO - Cleaning up... 19:23:28 INFO - Return code: 0 19:23:28 INFO - Done creating virtualenv /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv. 19:23:28 INFO - Getting output from command: ['/builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pip', 'freeze'] 19:23:28 INFO - Copy/paste: /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pip freeze 19:23:28 INFO - Reading from file tmpfile_stdout 19:23:28 INFO - Current package versions: 19:23:28 INFO - boto == 2.38.0 19:23:28 INFO - distribute == 0.6.24 19:23:28 INFO - wsgiref == 0.1.2 19:23:28 INFO - [mozharness: 2016-11-15 03:23:28.255008Z] Finished create-virtualenv step (success) 19:23:28 INFO - [mozharness: 2016-11-15 03:23:28.255193Z] Running collect-individual-checksums step. 19:23:28 INFO - Running main action method: collect_individual_checksums 19:23:28 INFO - Connecting to S3 19:23:28 INFO - Connecting to bucket net-mozaws-prod-delivery-firefox 19:23:28 INFO - File prefix is: pub/firefox/candidates/51.0b1-candidates/build1/ 19:23:28 INFO - Getting key names from bucket 19:23:35 INFO - Using beet format 19:24:56 INFO - [mozharness: 2016-11-15 03:24:56.487235Z] Finished collect-individual-checksums step (success) 19:24:56 INFO - [mozharness: 2016-11-15 03:24:56.487506Z] Running create-big-checksums step. 19:24:56 INFO - Running main action method: create_big_checksums 19:24:56 INFO - Creating big checksums file: SHA512SUMS 19:24:56 INFO - [mozharness: 2016-11-15 03:24:56.494159Z] Finished create-big-checksums step (success) 19:24:56 INFO - [mozharness: 2016-11-15 03:24:56.494390Z] Running sign step. 19:24:56 INFO - Running main action method: sign 19:24:56 INFO - retry: Calling _get_revision with args: (, '/builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools'), kwargs: {}, attempt #1 19:24:56 INFO - rmtree: /builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools 19:24:56 INFO - retry: attempt #1 caught exception: vcs share base not defined; refusing to operate sub-optimally 19:24:56 INFO - retry: Failed, sleeping 60 seconds before retrying 19:25:56 INFO - retry: Calling _get_revision with args: (, '/builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools'), kwargs: {}, attempt #2 19:25:56 INFO - rmtree: /builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools 19:25:56 INFO - retry: attempt #2 caught exception: vcs share base not defined; refusing to operate sub-optimally 19:25:56 INFO - retry: Failed, sleeping 120 seconds before retrying 19:27:56 INFO - retry: Calling _get_revision with args: (, '/builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools'), kwargs: {}, attempt #3 19:27:56 INFO - rmtree: /builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools 19:27:56 INFO - retry: attempt #3 caught exception: vcs share base not defined; refusing to operate sub-optimally 19:27:56 INFO - retry: Failed, sleeping 240 seconds before retrying 19:31:56 INFO - retry: Calling _get_revision with args: (, '/builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools'), kwargs: {}, attempt #4 19:31:56 INFO - rmtree: /builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools 19:31:56 INFO - retry: attempt #4 caught exception: vcs share base not defined; refusing to operate sub-optimally 19:31:56 INFO - retry: Failed, sleeping 300 seconds before retrying 19:36:56 INFO - retry: Calling _get_revision with args: (, '/builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools'), kwargs: {}, attempt #5 19:36:56 INFO - rmtree: /builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools 19:36:56 INFO - retry: attempt #5 caught exception: vcs share base not defined; refusing to operate sub-optimally 19:36:56 FATAL - Automation Error: Can't checkout /tools/checkouts/build-tools! 19:36:56 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 19:36:56 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 19:36:56 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 19:36:56 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 19:36:56 FATAL - Caught exception: vcs share base not defined; refusing to operate sub-optimally 19:36:56 FATAL - Running post_fatal callback... 19:36:56 FATAL - Exiting -1 19:36:56 INFO - [mozharness: 2016-11-15 03:36:56.862864Z] Finished sign step (failed) 19:36:56 INFO - Running post-run listener: copy_logs_to_upload_dir 19:36:56 INFO - Copying logs to upload dir... 19:36:56 INFO - mkdir: /builds/slave/rel-m-beta-fx_chcksms-00000000/build/upload/logs program finished with exit code 255 elapsedTime=812.507221 ========= master_lag: 0.01 ========= ========= Finished '/tools/buildbot/bin/python scripts/scripts/release/generate-checksums.py ...' failed (results: 2, elapsed: 13 mins, 32 secs) (at 2016-11-14 19:36:56.970476) ========= ========= Started no change (results: 0, elapsed: 0 secs) (at 2016-11-14 19:36:56.971759) ========= bash -c 'for file in `ls -1`; do cat $file; done' in dir /builds/slave/rel-m-beta-fx_chcksms-00000000/properties (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'for file in `ls -1`; do cat $file; done'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-420.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fx_chcksms-00000000/properties SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.005012 ========= master_lag: 0.04 ========= ========= Finished no change (results: 0, elapsed: 0 secs) (at 2016-11-14 19:36:57.019395) ========= ========= Started reboot skipped (results: 3, elapsed: 0 secs) (at 2016-11-14 19:36:57.019705) ========= ========= Finished reboot skipped (results: 3, elapsed: 0 secs) (at 2016-11-14 19:36:57.019938) ========= ========= Total master_lag: 0.20 =========