builder: mozilla-esr45-linux64-asan slave: bld-linux64-spot-572 starttime: 1457329640.72 results: failure (2) buildid: 20160306214709 builduid: e2011416bc11493d8c73ebec62bca233 revision: 7b2dfb80cd13d31b5653155b87c66c87dab8bdde ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.719592) ========= master: http://buildbot-master91.bb.releng.usw2.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.720398) ========= ========= Started set props: basedir (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.720687) ========= bash -c pwd in dir /builds/slave/m-esr45-l64-asan-0000000000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'pwd'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-572.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-esr45-l64-asan-0000000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False /builds/slave/m-esr45-l64-asan-0000000000000 program finished with exit code 0 elapsedTime=0.004046 basedir: '/builds/slave/m-esr45-l64-asan-0000000000000' ========= master_lag: 0.02 ========= ========= Finished set props: basedir (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.741167) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.741456) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.767287) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.767600) ========= rm -rf properties in dir /builds/slave/m-esr45-l64-asan-0000000000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'properties'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-572.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-esr45-l64-asan-0000000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002642 ========= master_lag: 0.09 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.859835) ========= ========= Started set props: script_repo_url (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.860142) ========= script_repo_url: https://hg.mozilla.org/build/mozharness ========= Finished set props: script_repo_url (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.860474) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.860755) ========= rm -rf scripts in dir /builds/slave/m-esr45-l64-asan-0000000000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-572.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-esr45-l64-asan-0000000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002546 ========= master_lag: 0.08 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.940290) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:20.940599) ========= bash -c 'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo releases/mozilla-esr45 --rev 7b2dfb80cd13d31b5653155b87c66c87dab8bdde --destination scripts --debug' in dir /builds/slave/m-esr45-l64-asan-0000000000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', u'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo releases/mozilla-esr45 --rev 7b2dfb80cd13d31b5653155b87c66c87dab8bdde --destination scripts --debug'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-572.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-esr45-l64-asan-0000000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 2016-03-06 21:47:20,987 truncating revision to first 12 chars 2016-03-06 21:47:20,987 Setting DEBUG logging. 2016-03-06 21:47:20,987 attempt 1/10 2016-03-06 21:47:20,987 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/releases/mozilla-esr45/7b2dfb80cd13?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2016-03-06 21:47:21,236 unpacking tar archive at: mozilla-esr45-7b2dfb80cd13/testing/mozharness/ program finished with exit code 0 elapsedTime=0.405824 ========= master_lag: 0.05 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:21.398682) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:21.441246) ========= echo 7b2dfb80cd13d31b5653155b87c66c87dab8bdde in dir /builds/slave/m-esr45-l64-asan-0000000000000/. (timeout 1200 secs) watching logfiles {} argv: ['echo', u'7b2dfb80cd13d31b5653155b87c66c87dab8bdde'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-572.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-esr45-l64-asan-0000000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 7b2dfb80cd13d31b5653155b87c66c87dab8bdde program finished with exit code 0 elapsedTime=0.003104 script_repo_revision: '7b2dfb80cd13d31b5653155b87c66c87dab8bdde' ========= master_lag: 0.03 ========= ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:21.474713) ========= ========= Started downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:21.475044) ========= ========= Finished downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2016-03-06 21:47:21.581668) ========= ========= Started '/tools/buildbot/bin/python scripts/scripts/fx_desktop_build.py ...' failed (results: 2, elapsed: 2 hrs, 14 mins, 21 secs) (at 2016-03-06 21:47:21.582031) ========= /tools/buildbot/bin/python scripts/scripts/fx_desktop_build.py --config builds/releng_base_linux_64_builds.py --custom-build-variant-cfg asan --config balrog/production.py --branch mozilla-esr45 --build-pool production in dir /builds/slave/m-esr45-l64-asan-0000000000000/. (timeout 10800 secs) (maxTime 19800 secs) watching logfiles {} argv: ['/tools/buildbot/bin/python', 'scripts/scripts/fx_desktop_build.py', '--config', 'builds/releng_base_linux_64_builds.py', '--custom-build-variant-cfg', 'asan', '--config', 'balrog/production.py', '--branch', 'mozilla-esr45', '--build-pool', 'production'] environment: CCACHE_COMPRESS=1 CCACHE_DIR=/builds/ccache CCACHE_HASHDIR= CCACHE_UMASK=002 DISPLAY=:2 G_BROKEN_FILENAMES=1 HG_SHARE_BASE_DIR=/builds/hg-shared HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-572.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LC_ALL=C LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZ_AUTOMATION=1 MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_OBJDIR=obj-firefox MOZ_SYMBOLS_EXTRA_BUILDID=linux64-asan PATH=/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin POST_SYMBOL_UPLOAD_CMD=/usr/local/bin/post-symbol-upload.py PROPERTIES_FILE=/builds/slave/m-esr45-l64-asan-0000000000000/buildprops.json PWD=/builds/slave/m-esr45-l64-asan-0000000000000 SHELL=/bin/bash SHLVL=1 SYMBOL_SERVER_HOST=symbolpush.mozilla.org SYMBOL_SERVER_PATH=/mnt/netapp/breakpad/symbols_ffx/ SYMBOL_SERVER_SSH_KEY=/home/mock_mozilla/.ssh/ffxbld_rsa SYMBOL_SERVER_USER=ffxbld TERM=linux TINDERBOX_OUTPUT=1 TMOUT=86400 TOOLTOOL_CACHE=/builds/tooltool_cache TOOLTOOL_HOME=/builds USER=cltbld _=/tools/buildbot/bin/python using PTY: False 21:47:21 INFO - MultiFileLogger online at 20160306 21:47:21 in /builds/slave/m-esr45-l64-asan-0000000000000 21:47:21 INFO - Script was run with '--custom-build-variant-cfg asan' and 'asan' matches a key in 'builds/releng_sub_linux_configs/64_asan.py'. Updating self.config with items from that key's value. 21:47:21 INFO - Script was run with '--build-pool production' and 'production' matches a key in 'builds/build_pool_specifics.py'. Updating self.config with items from that key's value. 21:47:21 INFO - To generate a config file based upon options passed and config files used, run script as before but extend options with "--dump-config" 21:47:21 INFO - For a diff of where self.config got its items, run the script again as before but extend options with: "--dump-config-hierarchy" 21:47:21 INFO - Both --dump-config and --dump-config-hierarchy don't actually run any actions. 21:47:21 INFO - We are running this in buildbot, grab the build props 21:47:21 INFO - Using buildbot properties: 21:47:21 INFO - { 21:47:21 INFO - "properties": { 21:47:21 INFO - "buildnumber": 0, 21:47:21 INFO - "product": "firefox", 21:47:21 INFO - "script_repo_revision": "production", 21:47:21 INFO - "branch": "mozilla-esr45", 21:47:21 INFO - "repository": "", 21:47:21 INFO - "buildername": "Linux x86-64 mozilla-esr45 asan build", 21:47:21 INFO - "buildid": "20160306214709", 21:47:21 INFO - "basedir": "/builds/slave/m-esr45-l64-asan-0000000000000", 21:47:21 INFO - "project": "", 21:47:21 INFO - "platform": "linux64-asan", 21:47:21 INFO - "master": "http://buildbot-master91.bb.releng.usw2.mozilla.com:8001/", 21:47:21 INFO - "builduid": "e2011416bc11493d8c73ebec62bca233", 21:47:21 INFO - "scheduler": "mozilla-esr45-firefox", 21:47:21 INFO - "repo_path": "releases/mozilla-esr45", 21:47:21 INFO - "slavename": "bld-linux64-spot-572", 21:47:21 INFO - "commit_titles": [ 21:47:21 INFO - "No bug, remove trailing whitespace to trigger builds, a=testonly" 21:47:21 INFO - ], 21:47:21 INFO - "revision": "7b2dfb80cd13d31b5653155b87c66c87dab8bdde" 21:47:21 INFO - }, 21:47:21 INFO - "sourcestamp": { 21:47:21 INFO - "repository": "", 21:47:21 INFO - "hasPatch": false, 21:47:21 INFO - "project": "", 21:47:21 INFO - "branch": "releases/mozilla-esr45", 21:47:21 INFO - "changes": [ 21:47:21 INFO - { 21:47:21 INFO - "category": null, 21:47:21 INFO - "files": [ 21:47:21 INFO - { 21:47:21 INFO - "url": null, 21:47:21 INFO - "name": "browser/components/search/test/browser_bing_behavior.js" 21:47:21 INFO - } 21:47:21 INFO - ], 21:47:21 INFO - "repository": "", 21:47:21 INFO - "rev": "7b2dfb80cd13d31b5653155b87c66c87dab8bdde", 21:47:21 INFO - "who": "philringnalda@gmail.com", 21:47:21 INFO - "when": 1457329574, 21:47:21 INFO - "number": 7700348, 21:47:21 INFO - "comments": "No bug, remove trailing whitespace to trigger builds, a=testonly", 21:47:21 INFO - "project": "", 21:47:21 INFO - "at": "Sun 06 Mar 2016 21:46:14", 21:47:21 INFO - "branch": "releases/mozilla-esr45", 21:47:21 INFO - "revlink": "https://hg.mozilla.org/releases/mozilla-esr45/rev/7b2dfb80cd13d31b5653155b87c66c87dab8bdde", 21:47:21 INFO - "properties": [ 21:47:21 INFO - [ 21:47:21 INFO - "commit_titles", 21:47:21 INFO - [ 21:47:21 INFO - "No bug, remove trailing whitespace to trigger builds, a=testonly" 21:47:21 INFO - ], 21:47:21 INFO - "BaseHgPoller" 21:47:21 INFO - ] 21:47:21 INFO - ], 21:47:21 INFO - "revision": "7b2dfb80cd13d31b5653155b87c66c87dab8bdde" 21:47:21 INFO - } 21:47:21 INFO - ], 21:47:21 INFO - "revision": "7b2dfb80cd13d31b5653155b87c66c87dab8bdde" 21:47:21 INFO - } 21:47:21 INFO - } 21:47:21 INFO - Setting buildbot property stage_platform to linux64-asan 21:47:21 INFO - mkdir: /builds/slave/m-esr45-l64-asan-0000000000000/properties 21:47:21 INFO - Writing buildbot properties ['stage_platform'] to /builds/slave/m-esr45-l64-asan-0000000000000/properties/stage_platform 21:47:21 INFO - Writing to file /builds/slave/m-esr45-l64-asan-0000000000000/properties/stage_platform 21:47:21 INFO - Contents: 21:47:21 INFO - stage_platform:linux64-asan 21:47:21 INFO - Run as scripts/scripts/fx_desktop_build.py --config builds/releng_base_linux_64_builds.py --custom-build-variant-cfg asan --config balrog/production.py --branch mozilla-esr45 --build-pool production 21:47:21 INFO - Determining buildid from buildbot properties 21:47:21 INFO - Setting buildbot property buildid to 20160306214709 21:47:21 INFO - Writing buildbot properties ['buildid'] to /builds/slave/m-esr45-l64-asan-0000000000000/properties/buildid 21:47:21 INFO - Writing to file /builds/slave/m-esr45-l64-asan-0000000000000/properties/buildid 21:47:21 INFO - Contents: 21:47:21 INFO - buildid:20160306214709 21:47:21 INFO - Determining builduid from buildbot properties 21:47:21 INFO - Setting buildbot property builduid to e2011416bc11493d8c73ebec62bca233 21:47:21 INFO - Writing buildbot properties ['builduid'] to /builds/slave/m-esr45-l64-asan-0000000000000/properties/builduid 21:47:21 INFO - Writing to file /builds/slave/m-esr45-l64-asan-0000000000000/properties/builduid 21:47:21 INFO - Contents: 21:47:21 INFO - builduid:e2011416bc11493d8c73ebec62bca233 21:47:21 INFO - Creating virtualenv /builds/slave/m-esr45-l64-asan-0000000000000/build/venv 21:47:21 INFO - mkdir: /builds/slave/m-esr45-l64-asan-0000000000000/build 21:47:21 INFO - Running command: ['virtualenv', '--no-site-packages', '--distribute', '/builds/slave/m-esr45-l64-asan-0000000000000/build/venv'] in /builds/slave/m-esr45-l64-asan-0000000000000/build 21:47:21 INFO - Copy/paste: virtualenv --no-site-packages --distribute /builds/slave/m-esr45-l64-asan-0000000000000/build/venv 21:47:21 INFO - The --no-site-packages flag is deprecated; it is now the default behavior. 21:47:21 INFO - New python executable in /builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/python2.7 21:47:21 INFO - Also creating executable in /builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/python 21:47:22 INFO - Installing distribute.............................................................................................................................................................................................done. 21:47:22 INFO - Installing pip...............done. 21:47:22 INFO - Return code: 0 21:47:22 INFO - Installing requests==2.8.1 into virtualenv /builds/slave/m-esr45-l64-asan-0000000000000/build/venv 21:47:22 INFO - retry: Calling run_command with args: [['/builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/pip', 'install', '--timeout', '120', 'requests==2.8.1']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x18890d0>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x16b8810>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x19c8f00>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x1954370>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x153da50>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x18b3350>, 'level': 'critical'}], 'cwd': '/builds/slave/m-esr45-l64-asan-0000000000000/build', 'env': {'MOZ_AUTOMATION': '1', 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'MOZ_OBJDIR': 'obj-firefox', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'SYMBOL_SERVER_USER': 'ffxbld', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 'HOME': '/home/cltbld', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 'CCACHE_DIR': '/builds/ccache', 'TINDERBOX_OUTPUT': '1', 'MAIL': '/var/spool/mail/cltbld', 'LC_ALL': 'C', 'TOOLTOOL_HOME': '/builds', '_': '/tools/buildbot/bin/python', 'HOSTNAME': 'bld-linux64-spot-572.build.releng.usw2.mozilla.com', 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 'MOZBUILD_STATE_PATH': '/builds/slave/m-esr45-l64-asan-0000000000000/.mozbuild', 'HISTCONTROL': 'ignoredups', 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 'PWD': '/builds/slave/m-esr45-l64-asan-0000000000000', 'PROPERTIES_FILE': '/builds/slave/m-esr45-l64-asan-0000000000000/buildprops.json', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'CCACHE_COMPRESS': '1', 'TOOLTOOL_CACHE': '/builds/tooltool_cache'}}, attempt #1 21:47:22 INFO - Running command: ['/builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/pip', 'install', '--timeout', '120', 'requests==2.8.1'] in /builds/slave/m-esr45-l64-asan-0000000000000/build 21:47:22 INFO - Copy/paste: /builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/pip install --timeout 120 requests==2.8.1 21:47:22 INFO - Using env: {'CCACHE_COMPRESS': '1', 21:47:22 INFO - 'CCACHE_DIR': '/builds/ccache', 21:47:22 INFO - 'CCACHE_HASHDIR': '', 21:47:22 INFO - 'CCACHE_UMASK': '002', 21:47:22 INFO - 'DISPLAY': ':2', 21:47:22 INFO - 'G_BROKEN_FILENAMES': '1', 21:47:22 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 21:47:22 INFO - 'HISTCONTROL': 'ignoredups', 21:47:22 INFO - 'HISTSIZE': '1000', 21:47:22 INFO - 'HOME': '/home/cltbld', 21:47:22 INFO - 'HOSTNAME': 'bld-linux64-spot-572.build.releng.usw2.mozilla.com', 21:47:22 INFO - 'LANG': 'en_US.UTF-8', 21:47:22 INFO - 'LC_ALL': 'C', 21:47:22 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 21:47:22 INFO - 'LOGNAME': 'cltbld', 21:47:22 INFO - 'MAIL': '/var/spool/mail/cltbld', 21:47:22 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-esr45-l64-asan-0000000000000/.mozbuild', 21:47:22 INFO - 'MOZ_AUTOMATION': '1', 21:47:22 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 21:47:22 INFO - 'MOZ_OBJDIR': 'obj-firefox', 21:47:22 INFO - 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 21:47:22 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 21:47:22 INFO - 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 21:47:22 INFO - 'PROPERTIES_FILE': '/builds/slave/m-esr45-l64-asan-0000000000000/buildprops.json', 21:47:22 INFO - 'PWD': '/builds/slave/m-esr45-l64-asan-0000000000000', 21:47:22 INFO - 'SHELL': '/bin/bash', 21:47:22 INFO - 'SHLVL': '1', 21:47:22 INFO - 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 21:47:22 INFO - 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 21:47:22 INFO - 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 21:47:22 INFO - 'SYMBOL_SERVER_USER': 'ffxbld', 21:47:22 INFO - 'TERM': 'linux', 21:47:22 INFO - 'TINDERBOX_OUTPUT': '1', 21:47:22 INFO - 'TMOUT': '86400', 21:47:22 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 21:47:22 INFO - 'TOOLTOOL_HOME': '/builds', 21:47:22 INFO - 'USER': 'cltbld', 21:47:22 INFO - '_': '/tools/buildbot/bin/python'} 21:47:23 INFO - Ignoring indexes: http://pypi.python.org/simple/ 21:47:23 INFO - Downloading/unpacking requests==2.8.1 21:47:23 INFO - Running setup.py egg_info for package requests 21:47:23 INFO - Installing collected packages: requests 21:47:23 INFO - Running setup.py install for requests 21:47:23 INFO - Successfully installed requests 21:47:23 INFO - Cleaning up... 21:47:23 INFO - Return code: 0 21:47:23 INFO - Installing PyHawk-with-a-single-extra-commit==0.1.5 into virtualenv /builds/slave/m-esr45-l64-asan-0000000000000/build/venv 21:47:23 INFO - retry: Calling run_command with args: [['/builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/pip', 'install', '--timeout', '120', 'PyHawk-with-a-single-extra-commit==0.1.5']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x18890d0>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x16b8810>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x19c8f00>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x1954370>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x153da50>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x18b3350>, 'level': 'critical'}], 'cwd': '/builds/slave/m-esr45-l64-asan-0000000000000/build', 'env': {'MOZ_AUTOMATION': '1', 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'MOZ_OBJDIR': 'obj-firefox', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'SYMBOL_SERVER_USER': 'ffxbld', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 'HOME': '/home/cltbld', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 'CCACHE_DIR': '/builds/ccache', 'TINDERBOX_OUTPUT': '1', 'MAIL': '/var/spool/mail/cltbld', 'LC_ALL': 'C', 'TOOLTOOL_HOME': '/builds', '_': '/tools/buildbot/bin/python', 'HOSTNAME': 'bld-linux64-spot-572.build.releng.usw2.mozilla.com', 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 'MOZBUILD_STATE_PATH': '/builds/slave/m-esr45-l64-asan-0000000000000/.mozbuild', 'HISTCONTROL': 'ignoredups', 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 'PWD': '/builds/slave/m-esr45-l64-asan-0000000000000', 'PROPERTIES_FILE': '/builds/slave/m-esr45-l64-asan-0000000000000/buildprops.json', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'CCACHE_COMPRESS': '1', 'TOOLTOOL_CACHE': '/builds/tooltool_cache'}}, attempt #1 21:47:23 INFO - Running command: ['/builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/pip', 'install', '--timeout', '120', 'PyHawk-with-a-single-extra-commit==0.1.5'] in /builds/slave/m-esr45-l64-asan-0000000000000/build 21:47:23 INFO - Copy/paste: /builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/pip install --timeout 120 PyHawk-with-a-single-extra-commit==0.1.5 21:47:23 INFO - Using env: {'CCACHE_COMPRESS': '1', 21:47:23 INFO - 'CCACHE_DIR': '/builds/ccache', 21:47:23 INFO - 'CCACHE_HASHDIR': '', 21:47:23 INFO - 'CCACHE_UMASK': '002', 21:47:23 INFO - 'DISPLAY': ':2', 21:47:23 INFO - 'G_BROKEN_FILENAMES': '1', 21:47:23 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 21:47:23 INFO - 'HISTCONTROL': 'ignoredups', 21:47:23 INFO - 'HISTSIZE': '1000', 21:47:23 INFO - 'HOME': '/home/cltbld', 21:47:23 INFO - 'HOSTNAME': 'bld-linux64-spot-572.build.releng.usw2.mozilla.com', 21:47:23 INFO - 'LANG': 'en_US.UTF-8', 21:47:23 INFO - 'LC_ALL': 'C', 21:47:23 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 21:47:23 INFO - 'LOGNAME': 'cltbld', 21:47:23 INFO - 'MAIL': '/var/spool/mail/cltbld', 21:47:23 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-esr45-l64-asan-0000000000000/.mozbuild', 21:47:23 INFO - 'MOZ_AUTOMATION': '1', 21:47:23 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 21:47:23 INFO - 'MOZ_OBJDIR': 'obj-firefox', 21:47:23 INFO - 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 21:47:23 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 21:47:23 INFO - 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 21:47:23 INFO - 'PROPERTIES_FILE': '/builds/slave/m-esr45-l64-asan-0000000000000/buildprops.json', 21:47:23 INFO - 'PWD': '/builds/slave/m-esr45-l64-asan-0000000000000', 21:47:23 INFO - 'SHELL': '/bin/bash', 21:47:23 INFO - 'SHLVL': '1', 21:47:23 INFO - 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 21:47:23 INFO - 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 21:47:23 INFO - 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 21:47:23 INFO - 'SYMBOL_SERVER_USER': 'ffxbld', 21:47:23 INFO - 'TERM': 'linux', 21:47:23 INFO - 'TINDERBOX_OUTPUT': '1', 21:47:23 INFO - 'TMOUT': '86400', 21:47:23 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 21:47:23 INFO - 'TOOLTOOL_HOME': '/builds', 21:47:23 INFO - 'USER': 'cltbld', 21:47:23 INFO - '_': '/tools/buildbot/bin/python'} 21:47:24 INFO - Ignoring indexes: http://pypi.python.org/simple/ 21:47:24 INFO - Downloading/unpacking PyHawk-with-a-single-extra-commit==0.1.5 21:47:24 INFO - Downloading PyHawk-with-a-single-extra-commit-0.1.5.tar.gz 21:47:24 INFO - Running setup.py egg_info for package PyHawk-with-a-single-extra-commit 21:47:24 INFO - Installing collected packages: PyHawk-with-a-single-extra-commit 21:47:24 INFO - Running setup.py install for PyHawk-with-a-single-extra-commit 21:47:24 INFO - Successfully installed PyHawk-with-a-single-extra-commit 21:47:24 INFO - Cleaning up... 21:47:24 INFO - Return code: 0 21:47:24 INFO - Installing taskcluster==0.0.15 into virtualenv /builds/slave/m-esr45-l64-asan-0000000000000/build/venv 21:47:24 INFO - retry: Calling run_command with args: [['/builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/pip', 'install', '--timeout', '120', 'taskcluster==0.0.15']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x18890d0>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x16b8810>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x19c8f00>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x1954370>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x153da50>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x18b3350>, 'level': 'critical'}], 'cwd': '/builds/slave/m-esr45-l64-asan-0000000000000/build', 'env': {'MOZ_AUTOMATION': '1', 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'MOZ_OBJDIR': 'obj-firefox', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'SYMBOL_SERVER_USER': 'ffxbld', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 'HOME': '/home/cltbld', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 'CCACHE_DIR': '/builds/ccache', 'TINDERBOX_OUTPUT': '1', 'MAIL': '/var/spool/mail/cltbld', 'LC_ALL': 'C', 'TOOLTOOL_HOME': '/builds', '_': '/tools/buildbot/bin/python', 'HOSTNAME': 'bld-linux64-spot-572.build.releng.usw2.mozilla.com', 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 'MOZBUILD_STATE_PATH': '/builds/slave/m-esr45-l64-asan-0000000000000/.mozbuild', 'HISTCONTROL': 'ignoredups', 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 'PWD': '/builds/slave/m-esr45-l64-asan-0000000000000', 'PROPERTIES_FILE': '/builds/slave/m-esr45-l64-asan-0000000000000/buildprops.json', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'CCACHE_COMPRESS': '1', 'TOOLTOOL_CACHE': '/builds/tooltool_cache'}}, attempt #1 21:47:24 INFO - Running command: ['/builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/pip', 'install', '--timeout', '120', 'taskcluster==0.0.15'] in /builds/slave/m-esr45-l64-asan-0000000000000/build 21:47:24 INFO - Copy/paste: /builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/pip install --timeout 120 taskcluster==0.0.15 21:47:24 INFO - Using env: {'CCACHE_COMPRESS': '1', 21:47:24 INFO - 'CCACHE_DIR': '/builds/ccache', 21:47:24 INFO - 'CCACHE_HASHDIR': '', 21:47:24 INFO - 'CCACHE_UMASK': '002', 21:47:24 INFO - 'DISPLAY': ':2', 21:47:24 INFO - 'G_BROKEN_FILENAMES': '1', 21:47:24 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 21:47:24 INFO - 'HISTCONTROL': 'ignoredups', 21:47:24 INFO - 'HISTSIZE': '1000', 21:47:24 INFO - 'HOME': '/home/cltbld', 21:47:24 INFO - 'HOSTNAME': 'bld-linux64-spot-572.build.releng.usw2.mozilla.com', 21:47:24 INFO - 'LANG': 'en_US.UTF-8', 21:47:24 INFO - 'LC_ALL': 'C', 21:47:24 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 21:47:24 INFO - 'LOGNAME': 'cltbld', 21:47:24 INFO - 'MAIL': '/var/spool/mail/cltbld', 21:47:24 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-esr45-l64-asan-0000000000000/.mozbuild', 21:47:24 INFO - 'MOZ_AUTOMATION': '1', 21:47:24 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 21:47:24 INFO - 'MOZ_OBJDIR': 'obj-firefox', 21:47:24 INFO - 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 21:47:24 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 21:47:24 INFO - 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 21:47:24 INFO - 'PROPERTIES_FILE': '/builds/slave/m-esr45-l64-asan-0000000000000/buildprops.json', 21:47:24 INFO - 'PWD': '/builds/slave/m-esr45-l64-asan-0000000000000', 21:47:24 INFO - 'SHELL': '/bin/bash', 21:47:24 INFO - 'SHLVL': '1', 21:47:24 INFO - 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 21:47:24 INFO - 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 21:47:24 INFO - 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 21:47:24 INFO - 'SYMBOL_SERVER_USER': 'ffxbld', 21:47:24 INFO - 'TERM': 'linux', 21:47:24 INFO - 'TINDERBOX_OUTPUT': '1', 21:47:24 INFO - 'TMOUT': '86400', 21:47:24 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 21:47:24 INFO - 'TOOLTOOL_HOME': '/builds', 21:47:24 INFO - 'USER': 'cltbld', 21:47:24 INFO - '_': '/tools/buildbot/bin/python'} 21:47:26 INFO - Ignoring indexes: http://pypi.python.org/simple/ 21:47:26 INFO - Downloading/unpacking taskcluster==0.0.15 21:47:26 INFO - Downloading taskcluster-0.0.15.tar.gz 21:47:26 INFO - Running setup.py egg_info for package taskcluster 21:47:26 INFO - Downloading/unpacking requests==2.4.3 (from taskcluster==0.0.15) 21:47:26 INFO - Running setup.py egg_info for package requests 21:47:26 INFO - Requirement already satisfied (use --upgrade to upgrade): PyHawk-with-a-single-extra-commit==0.1.5 in ./venv/lib/python2.7/site-packages (from taskcluster==0.0.15) 21:47:26 INFO - Installing collected packages: taskcluster, requests 21:47:26 INFO - Running setup.py install for taskcluster 21:47:26 INFO - Found existing installation: requests 2.8.1 21:47:26 INFO - Uninstalling requests: 21:47:26 INFO - Successfully uninstalled requests 21:47:26 INFO - Running setup.py install for requests 21:47:26 INFO - Successfully installed taskcluster requests 21:47:26 INFO - Cleaning up... 21:47:26 INFO - Return code: 0 21:47:26 INFO - Done creating virtualenv /builds/slave/m-esr45-l64-asan-0000000000000/build/venv. 21:47:26 INFO - Getting output from command: ['/builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/pip', 'freeze'] 21:47:26 INFO - Copy/paste: /builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/pip freeze 21:47:26 INFO - Reading from file tmpfile_stdout 21:47:26 INFO - Current package versions: 21:47:26 INFO - PyHawk-with-a-single-extra-commit == 0.1.5 21:47:26 INFO - distribute == 0.6.24 21:47:26 INFO - requests == 2.4.3 21:47:26 INFO - taskcluster == 0.0.15 21:47:26 INFO - wsgiref == 0.1.2 21:47:26 INFO - Running pre-run listener: influxdb_recording_init 21:47:26 INFO - build_resources.json path: /builds/slave/m-esr45-l64-asan-0000000000000/build/src/obj-firefox/.mozbuild/build_resources.json 21:47:26 INFO - rmtree: /builds/slave/m-esr45-l64-asan-0000000000000/build/src/obj-firefox/.mozbuild/build_resources.json 21:47:26 INFO - Getting output from command: ['/builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/python', '-c', 'from distutils.sysconfig import get_python_lib; print(get_python_lib())'] 21:47:26 INFO - Copy/paste: /builds/slave/m-esr45-l64-asan-0000000000000/build/venv/bin/python -c "from distutils.sysconfig import get_python_lib; print(get_python_lib())" 21:47:26 INFO - Reading from file tmpfile_stdout 21:47:26 INFO - Output received: 21:47:26 INFO - /builds/slave/m-esr45-l64-asan-0000000000000/build/venv/lib/python2.7/site-packages 21:47:26 INFO - Dumping config to /builds/slave/m-esr45-l64-asan-0000000000000/logs/localconfig.json. 21:47:26 INFO - {'app_ini_path': '%(obj_dir)s/dist/bin/application.ini', 21:47:26 INFO - 'append_to_log': False, 21:47:26 INFO - 'balrog_credentials_file': 'oauth.txt', 21:47:26 INFO - 'balrog_servers': ({'balrog_api_root': 'https://aus4-admin.mozilla.org/api', 21:47:26 INFO - 'balrog_usernames': {'Fennec': 'ffxbld', 21:47:26 INFO - 'b2g': 'b2gbld', 21:47:26 INFO - 'firefox': 'ffxbld', 21:47:26 INFO - 'graphene': 'ffxbld', 21:47:26 INFO - 'horizon': 'ffxbld', 21:47:26 INFO - 'mobile': 'ffxbld', 21:47:26 INFO - 'thunderbird': 'tbirdbld'}, 21:47:26 INFO - 'ignore_failures': False, 21:47:26 INFO - 'url_replacements': (('http://archive.mozilla.org/pub', 21:47:26 INFO - 'http://download.cdn.mozilla.net/pub'),)}, 21:47:26 INFO - {'balrog_api_root': 'https://aus4-admin-dev.allizom.org/api', 21:47:26 INFO - 'balrog_usernames': {'Fennec': 'stage-ffxbld', 21:47:26 INFO - 'b2g': 'stage-b2gbld', 21:47:26 INFO - 'firefox': 'stage-ffxbld', 21:47:26 INFO - 'graphene': 'stage-ffxbld', 21:47:26 INFO - 'horizon': 'stage-ffxbld', 21:47:26 INFO - 'mobile': 'stage-ffxbld', 21:47:26 INFO - 'thunderbird': 'stage-tbirdbld'}, 21:47:26 INFO - 'ignore_failures': True}), 21:47:26 INFO - 'base_name': 'Linux_x86-64_%(branch)s', 21:47:26 INFO - 'base_work_dir': '/builds/slave/m-esr45-l64-asan-0000000000000', 21:47:26 INFO - 'branch': 'mozilla-esr45', 21:47:26 INFO - 'build_pool': 'production', 21:47:26 INFO - 'build_resources_path': '%(abs_src_dir)s/obj-firefox/.mozbuild/build_resources.json', 21:47:26 INFO - 'build_type': 'asan', 21:47:26 INFO - 'build_variant': 'asan', 21:47:26 INFO - 'buildbot_json_path': 'buildprops.json', 21:47:26 INFO - 'check_test_env': {'MINIDUMP_SAVE_PATH': '%(base_work_dir)s/minidumps', 21:47:26 INFO - 'MINIDUMP_STACKWALK': '%(abs_tools_dir)s/breakpad/linux64/minidump_stackwalk'}, 21:47:26 INFO - 'clobberer_url': 'https://api.pub.build.mozilla.org/clobberer/lastclobber', 21:47:26 INFO - 'clone_by_revision': False, 21:47:26 INFO - 'clone_with_purge': False, 21:47:26 INFO - 'compare_locales_repo': 'https://hg.mozilla.org/build/compare-locales', 21:47:26 INFO - 'compare_locales_rev': 'RELEASE_AUTOMATION', 21:47:26 INFO - 'compare_locales_vcs': 'hgtool', 21:47:26 INFO - 'config_files': ('builds/releng_base_linux_64_builds.py', 21:47:26 INFO - '/builds/slave/m-esr45-l64-asan-0000000000000/scripts/scripts/../configs/builds/releng_sub_linux_configs/64_asan.py', 21:47:26 INFO - 'balrog/production.py', 21:47:26 INFO - 'builds/branch_specifics.py', 21:47:26 INFO - 'builds/build_pool_specifics.py'), 21:47:26 INFO - 'debug_build': False, 21:47:26 INFO - 'default_actions': ('clobber', 21:47:26 INFO - 'clone-tools', 21:47:26 INFO - 'checkout-sources', 21:47:26 INFO - 'setup-mock', 21:47:26 INFO - 'build', 21:47:26 INFO - 'upload-files', 21:47:26 INFO - 'sendchange', 21:47:26 INFO - 'check-test'), 21:47:26 INFO - 'default_vcs': 'hgtool', 21:47:26 INFO - 'enable_ccache': True, 21:47:26 INFO - 'enable_count_ctors': True, 21:47:26 INFO - 'enable_signing': False, 21:47:26 INFO - 'enable_talos_sendchange': False, 21:47:26 INFO - 'enable_unittest_sendchange': True, 21:47:26 INFO - 'env': {'CCACHE_COMPRESS': '1', 21:47:26 INFO - 'CCACHE_DIR': '/builds/ccache', 21:47:26 INFO - 'CCACHE_UMASK': '002', 21:47:26 INFO - 'DISPLAY': ':2', 21:47:26 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 21:47:26 INFO - 'LC_ALL': 'C', 21:47:26 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-esr45-l64-asan-0000000000000/.mozbuild', 21:47:26 INFO - 'MOZ_AUTOMATION': '1', 21:47:26 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 21:47:26 INFO - 'MOZ_OBJDIR': 'obj-firefox', 21:47:26 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 21:47:26 INFO - 'TINDERBOX_OUTPUT': '1', 21:47:26 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 21:47:26 INFO - 'TOOLTOOL_HOME': '/builds'}, 21:47:26 INFO - 'exes': {'buildbot': '/tools/buildbot/bin/buildbot', 21:47:26 INFO - 'hgtool.py': '/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py'}, 21:47:26 INFO - 'graph_selector': '/server/collect.cgi', 21:47:26 INFO - 'graph_server': 'graphs.mozilla.org', 21:47:26 INFO - 'hgtool_base_bundle_urls': ('https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles',), 21:47:26 INFO - 'include_post_upload_builddir': False, 21:47:26 INFO - 'influx_credentials_file': 'oauth.txt', 21:47:26 INFO - 'is_automation': True, 21:47:26 INFO - 'latest_mar_dir': '/pub/mozilla.org/firefox/nightly/latest-%(branch)s', 21:47:26 INFO - 'log_level': 'info', 21:47:26 INFO - 'log_to_console': True, 21:47:26 INFO - 'mock_files': (('/home/cltbld/.ssh', '/home/mock_mozilla/.ssh'), 21:47:26 INFO - ('/home/cltbld/.hgrc', '/builds/.hgrc'), 21:47:26 INFO - ('/home/cltbld/.boto', '/builds/.boto'), 21:47:26 INFO - ('/builds/gapi.data', '/builds/gapi.data'), 21:47:26 INFO - ('/builds/relengapi.tok', '/builds/relengapi.tok'), 21:47:26 INFO - ('/tools/tooltool.py', '/builds/tooltool.py'), 21:47:26 INFO - ('/builds/mozilla-desktop-geoloc-api.key', 21:47:26 INFO - '/builds/mozilla-desktop-geoloc-api.key'), 21:47:26 INFO - ('/builds/crash-stats-api.token', 21:47:26 INFO - '/builds/crash-stats-api.token'), 21:47:26 INFO - ('/builds/adjust-sdk.token', '/builds/adjust-sdk.token'), 21:47:26 INFO - ('/usr/local/lib/hgext', '/usr/local/lib/hgext')), 21:47:26 INFO - 'mock_mozilla_dir': '/builds/mock_mozilla', 21:47:26 INFO - 'mock_packages': ('autoconf213', 21:47:26 INFO - 'python', 21:47:26 INFO - 'mozilla-python27', 21:47:26 INFO - 'zip', 21:47:26 INFO - 'mozilla-python27-mercurial', 21:47:26 INFO - 'git', 21:47:26 INFO - 'ccache', 21:47:26 INFO - 'perl-Test-Simple', 21:47:26 INFO - 'perl-Config-General', 21:47:26 INFO - 'yasm', 21:47:26 INFO - 'wget', 21:47:26 INFO - 'mpfr', 21:47:26 INFO - 'xorg-x11-font*', 21:47:26 INFO - 'imake', 21:47:26 INFO - 'gcc45_0moz3', 21:47:26 INFO - 'gcc454_0moz1', 21:47:26 INFO - 'gcc472_0moz1', 21:47:26 INFO - 'gcc473_0moz1', 21:47:26 INFO - 'yasm', 21:47:26 INFO - 'ccache', 21:47:26 INFO - 'valgrind', 21:47:26 INFO - 'dbus-x11', 21:47:26 INFO - 'glibc-static', 21:47:26 INFO - 'libstdc++-static', 21:47:26 INFO - 'gtk2-devel', 21:47:26 INFO - 'libnotify-devel', 21:47:26 INFO - 'alsa-lib-devel', 21:47:26 INFO - 'libcurl-devel', 21:47:26 INFO - 'wireless-tools-devel', 21:47:26 INFO - 'libX11-devel', 21:47:26 INFO - 'libXt-devel', 21:47:26 INFO - 'mesa-libGL-devel', 21:47:26 INFO - 'gnome-vfs2-devel', 21:47:26 INFO - 'GConf2-devel', 21:47:26 INFO - 'gcc45_0moz3', 21:47:26 INFO - 'gcc454_0moz1', 21:47:26 INFO - 'gcc472_0moz1', 21:47:26 INFO - 'gcc473_0moz1', 21:47:26 INFO - 'yasm', 21:47:26 INFO - 'ccache', 21:47:26 INFO - 'pulseaudio-libs-devel', 21:47:26 INFO - 'gstreamer-devel', 21:47:26 INFO - 'gstreamer-plugins-base-devel', 21:47:26 INFO - 'freetype-2.3.11-6.el6_1.8.x86_64', 21:47:26 INFO - 'freetype-devel-2.3.11-6.el6_1.8.x86_64'), 21:47:26 INFO - 'mock_target': 'mozilla-centos6-x86_64', 21:47:26 INFO - 'nightly_build': False, 21:47:26 INFO - 'nightly_promotion_branches': ('mozilla-central', 'mozilla-aurora'), 21:47:26 INFO - 'objdir': 'obj-firefox', 21:47:26 INFO - 'old_packages': ('%(objdir)s/dist/firefox-*', 21:47:26 INFO - '%(objdir)s/dist/fennec*', 21:47:26 INFO - '%(objdir)s/dist/seamonkey*', 21:47:26 INFO - '%(objdir)s/dist/thunderbird*', 21:47:26 INFO - '%(objdir)s/dist/install/sea/*.exe'), 21:47:26 INFO - 'opt_config_files': (), 21:47:26 INFO - 'periodic_clobber': 168, 21:47:26 INFO - 'pgo_build': False, 21:47:26 INFO - 'pgo_platforms': ('linux', 'linux64', 'win32', 'win64'), 21:47:26 INFO - 'platform': 'linux64', 21:47:26 INFO - 'platform_supports_post_upload_to_latest': False, 21:47:26 INFO - 'publish_nightly_en_US_routes': False, 21:47:26 INFO - 'purge_basedirs': ('/mock/users/cltbld/home/cltbld/build',), 21:47:26 INFO - 'purge_minsize': 12, 21:47:26 INFO - 'purge_skip': ('info', 'rel-*:10d', 'tb-rel-*:10d'), 21:47:26 INFO - 'release_to_try_builds': False, 21:47:26 INFO - 'repo_base': 'https://hg.mozilla.org', 21:47:26 INFO - 'sendchange_masters': ('buildbot-master81.build.mozilla.org:9301',), 21:47:26 INFO - 'src_mozconfig': 'browser/config/mozconfigs/linux64/nightly-asan', 21:47:26 INFO - 'stage_platform': 'linux64-asan', 21:47:26 INFO - 'stage_product': 'firefox', 21:47:26 INFO - 'stage_ssh_key': 'ffxbld_rsa', 21:47:26 INFO - 'stage_username': 'ffxbld', 21:47:26 INFO - 'symbol_server_host': 'symbolpush.mozilla.org', 21:47:26 INFO - 'taskcluster_credentials_file': 'oauth.txt', 21:47:26 INFO - 'taskcluster_index': 'index', 21:47:26 INFO - 'tinderbox_build_dir': None, 21:47:26 INFO - 'to_tinderbox_dated': True, 21:47:26 INFO - 'tools_repo': 'https://hg.mozilla.org/build/tools', 21:47:26 INFO - 'tooltool_bootstrap': 'setup.sh', 21:47:26 INFO - 'tooltool_manifest_src': 'browser/config/tooltool-manifests/linux64/asan.manifest', 21:47:26 INFO - 'tooltool_script': ('/builds/tooltool.py',), 21:47:26 INFO - 'tooltool_url': 'https://api.pub.build.mozilla.org/tooltool/', 21:47:26 INFO - 'upload_env': {'UPLOAD_HOST': '%(stage_server)s', 21:47:26 INFO - 'UPLOAD_SSH_KEY': '/home/mock_mozilla/.ssh/%(stage_ssh_key)s', 21:47:26 INFO - 'UPLOAD_TO_TEMP': '1', 21:47:26 INFO - 'UPLOAD_USER': '%(stage_username)s'}, 21:47:26 INFO - 'use_branch_in_symbols_extra_buildid': True, 21:47:26 INFO - 'use_clobberer': True, 21:47:26 INFO - 'use_platform_in_symbols_extra_buildid': True, 21:47:26 INFO - 'vcs_share_base': '/builds/hg-shared', 21:47:26 INFO - 'virtualenv_modules': ('requests==2.8.1', 21:47:26 INFO - 'PyHawk-with-a-single-extra-commit==0.1.5', 21:47:26 INFO - 'taskcluster==0.0.15'), 21:47:26 INFO - 'virtualenv_path': 'venv', 21:47:26 INFO - 'volatile_config': {'actions': None, 'add_actions': None, 'no_actions': None}, 21:47:26 INFO - 'who': '', 21:47:26 INFO - 'work_dir': 'build'} 21:47:26 INFO - ##### 21:47:26 INFO - ##### Running clobber step. 21:47:26 INFO - ##### 21:47:26 INFO - Running pre-action listener: influxdb_recording_pre_action 21:47:26 INFO - Running main action method: clobber 21:47:26 INFO - retry: Calling run_command with args: [['/builds/slave/m-esr45-l64-asan-0000000000000/scripts/external_tools/clobberer.py', '-s', 'scripts', '-s', 'logs', '-s', 'buildprops.json', '-s', 'token', '-s', 'oauth.txt', '-t', '168', 'https://api.pub.build.mozilla.org/clobberer/lastclobber', u'mozilla-esr45', u'Linux x86-64 mozilla-esr45 asan build', 'm-esr45-l64-asan-0000000000000', u'bld-linux64-spot-572', u'http://buildbot-master91.bb.releng.usw2.mozilla.com:8001/']], kwargs: {'error_list': [{'substr': 'Error contacting server', 'explanation': 'Error contacting server for clobberer information.', 'level': 'error'}], 'cwd': '/builds/slave'}, attempt #1 21:47:26 INFO - Running command: ['/builds/slave/m-esr45-l64-asan-0000000000000/scripts/external_tools/clobberer.py', '-s', 'scripts', '-s', 'logs', '-s', 'buildprops.json', '-s', 'token', '-s', 'oauth.txt', '-t', '168', 'https://api.pub.build.mozilla.org/clobberer/lastclobber', u'mozilla-esr45', u'Linux x86-64 mozilla-esr45 asan build', 'm-esr45-l64-asan-0000000000000', u'bld-linux64-spot-572', u'http://buildbot-master91.bb.releng.usw2.mozilla.com:8001/'] in /builds/slave 21:47:26 INFO - Copy/paste: /builds/slave/m-esr45-l64-asan-0000000000000/scripts/external_tools/clobberer.py -s scripts -s logs -s buildprops.json -s token -s oauth.txt -t 168 https://api.pub.build.mozilla.org/clobberer/lastclobber mozilla-esr45 "Linux x86-64 mozilla-esr45 asan build" m-esr45-l64-asan-0000000000000 bld-linux64-spot-572 http://buildbot-master91.bb.releng.usw2.mozilla.com:8001/ 21:47:26 INFO - Checking clobber URL: https://api.pub.build.mozilla.org/clobberer/lastclobber?master=http%3A%2F%2Fbuildbot-master91.bb.releng.usw2.mozilla.com%3A8001%2F&slave=bld-linux64-spot-572&builddir=m-esr45-l64-asan-0000000000000&branch=mozilla-esr45&buildername=Linux+x86-64+mozilla-esr45+asan+build 21:47:26 INFO - m-esr45-l64-asan-0000000000000:Our last clobber date: None 21:47:26 INFO - m-esr45-l64-asan-0000000000000:Server clobber date: None 21:47:26 INFO - TinderboxPrint: purged clobber 21:47:26 INFO - Return code: 0 21:47:26 INFO - Running command: ['/builds/slave/m-esr45-l64-asan-0000000000000/scripts/external_tools/purge_builds.py', '-s', '12', '--max-age', '14', '--not', 'info', '--not', 'rel-*:10d', '--not', 'tb-rel-*:10d', '/builds/slave', '/mock/users/cltbld/home/cltbld/build'] 21:47:26 INFO - Copy/paste: /builds/slave/m-esr45-l64-asan-0000000000000/scripts/external_tools/purge_builds.py -s 12 --max-age 14 --not info --not rel-*:10d --not tb-rel-*:10d /builds/slave /mock/users/cltbld/home/cltbld/build 21:47:26 INFO - Using env: {'HG_SHARE_BASE_DIR': '/builds/hg-shared', 21:47:26 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin'} 21:47:26 INFO - 64.33 GB of space available 21:47:26 INFO - Return code: 0 21:47:26 INFO - Running post-action listener: influxdb_recording_post_action 21:47:26 INFO - Starting new HTTPS connection (1): goldiewilson-onepointtwentyone-1.c.influxdb.com 21:47:27 INFO - ##### 21:47:27 INFO - ##### Running clone-tools step. 21:47:27 INFO - ##### 21:47:27 INFO - Running pre-action listener: influxdb_recording_pre_action 21:47:27 INFO - Running main action method: clone_tools 21:47:27 INFO - retry: Calling _get_revision with args: (, '/builds/slave/m-esr45-l64-asan-0000000000000/build/tools'), kwargs: {}, attempt #1 21:47:27 INFO - Setting /builds/slave/m-esr45-l64-asan-0000000000000/build/tools to https://hg.mozilla.org/build/tools using shared directory /builds/hg-shared. 21:47:27 INFO - Checking if share extension works. 21:47:27 INFO - Getting output from command: ['hg', '--config', 'ui.merge=internal:merge', 'help', 'share'] 21:47:27 INFO - Copy/paste: hg --config ui.merge=internal:merge help share 21:47:27 INFO - Reading from file tmpfile_stdout 21:47:27 INFO - hg share works. 21:47:27 INFO - Updating shared repo 21:47:27 INFO - Pulling https://hg.mozilla.org/build/tools to /builds/hg-shared/build/tools and updating. 21:47:27 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', 'pull', 'https://hg.mozilla.org/build/tools'] in /builds/hg-shared/build/tools 21:47:27 INFO - Copy/paste: hg --config ui.merge=internal:merge pull https://hg.mozilla.org/build/tools 21:47:27 INFO - Calling ['hg', '--config', 'ui.merge=internal:merge', 'pull', 'https://hg.mozilla.org/build/tools'] with output_timeout 1200 21:47:27 INFO - pulling from https://hg.mozilla.org/build/tools 21:47:27 INFO - searching for changes 21:47:27 INFO - no changes found 21:47:27 INFO - Return code: 0 21:47:27 INFO - Updating /builds/hg-shared/build/tools. 21:47:27 INFO - Getting output from command: ['hg', '--config', 'ui.merge=internal:merge', 'branch'] in /builds/hg-shared/build/tools 21:47:27 INFO - Copy/paste: hg --config ui.merge=internal:merge branch 21:47:28 INFO - Reading from file tmpfile_stdout 21:47:28 INFO - Output received: 21:47:28 INFO - default 21:47:28 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', 'update', '-C'] in /builds/hg-shared/build/tools 21:47:28 INFO - Copy/paste: hg --config ui.merge=internal:merge update -C 21:47:29 INFO - 0 files updated, 0 files merged, 0 files removed, 0 files unresolved 21:47:29 INFO - Return code: 0 21:47:29 INFO - Getting output from command: ['hg', '--config', 'ui.merge=internal:merge', 'parent', '--template', '{node}'] in /builds/hg-shared/build/tools 21:47:29 INFO - Copy/paste: hg --config ui.merge=internal:merge parent --template {node} 21:47:29 INFO - Reading from file tmpfile_stdout 21:47:29 INFO - Output received: 21:47:29 INFO - 4bad2d85bed815363fabfdec394c2fb65781dc53 21:47:29 INFO - Trying to share /builds/hg-shared/build/tools to /builds/slave/m-esr45-l64-asan-0000000000000/build/tools 21:47:29 INFO - Sharing /builds/hg-shared/build/tools to /builds/slave/m-esr45-l64-asan-0000000000000/build/tools. 21:47:29 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', 'share', '-U', '/builds/hg-shared/build/tools', '/builds/slave/m-esr45-l64-asan-0000000000000/build/tools'] 21:47:29 INFO - Copy/paste: hg --config ui.merge=internal:merge share -U /builds/hg-shared/build/tools /builds/slave/m-esr45-l64-asan-0000000000000/build/tools 21:47:30 INFO - Return code: 0 21:47:30 INFO - Updating /builds/slave/m-esr45-l64-asan-0000000000000/build/tools. 21:47:30 INFO - Getting output from command: ['hg', '--config', 'ui.merge=internal:merge', 'branch'] in /builds/slave/m-esr45-l64-asan-0000000000000/build/tools 21:47:30 INFO - Copy/paste: hg --config ui.merge=internal:merge branch 21:47:30 INFO - Reading from file tmpfile_stdout 21:47:30 INFO - Output received: 21:47:30 INFO - default 21:47:30 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', 'update', '-C'] in /builds/slave/m-esr45-l64-asan-0000000000000/build/tools 21:47:30 INFO - Copy/paste: hg --config ui.merge=internal:merge update -C 21:47:31 INFO - 1174 files updated, 0 files merged, 0 files removed, 0 files unresolved 21:47:31 INFO - Return code: 0 21:47:31 INFO - Getting output from command: ['hg', '--config', 'ui.merge=internal:merge', 'parent', '--template', '{node}'] in /builds/slave/m-esr45-l64-asan-0000000000000/build/tools 21:47:31 INFO - Copy/paste: hg --config ui.merge=internal:merge parent --template {node} 21:47:31 INFO - Reading from file tmpfile_stdout 21:47:31 INFO - Output received: 21:47:31 INFO - 4bad2d85bed815363fabfdec394c2fb65781dc53 21:47:31 INFO - Running post-action listener: influxdb_recording_post_action 21:47:31 INFO - ##### 21:47:31 INFO - ##### Running checkout-sources step. 21:47:31 INFO - ##### 21:47:31 INFO - Running pre-action listener: influxdb_recording_pre_action 21:47:31 INFO - Running main action method: checkout_sources 21:47:31 INFO - repo_path not in config. Using 'projects/mozilla-esr45' instead 21:47:31 INFO - retry: Calling _get_revision with args: (, '/builds/slave/m-esr45-l64-asan-0000000000000/build/src'), kwargs: {}, attempt #1 21:47:31 INFO - Running command: ['/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', '--bundle', 'https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src'] 21:47:31 INFO - Copy/paste: /builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde --bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg https://hg.mozilla.org/projects/mozilla-esr45 /builds/slave/m-esr45-l64-asan-0000000000000/build/src 21:47:31 INFO - Using env: {'CCACHE_COMPRESS': '1', 21:47:31 INFO - 'CCACHE_DIR': '/builds/ccache', 21:47:31 INFO - 'CCACHE_HASHDIR': '', 21:47:31 INFO - 'CCACHE_UMASK': '002', 21:47:31 INFO - 'DISPLAY': ':2', 21:47:31 INFO - 'G_BROKEN_FILENAMES': '1', 21:47:31 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 21:47:31 INFO - 'HISTCONTROL': 'ignoredups', 21:47:31 INFO - 'HISTSIZE': '1000', 21:47:31 INFO - 'HOME': '/home/cltbld', 21:47:31 INFO - 'HOSTNAME': 'bld-linux64-spot-572.build.releng.usw2.mozilla.com', 21:47:31 INFO - 'LANG': 'en_US.UTF-8', 21:47:31 INFO - 'LC_ALL': 'C', 21:47:31 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 21:47:31 INFO - 'LOGNAME': 'cltbld', 21:47:31 INFO - 'MAIL': '/var/spool/mail/cltbld', 21:47:31 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-esr45-l64-asan-0000000000000/.mozbuild', 21:47:31 INFO - 'MOZ_AUTOMATION': '1', 21:47:31 INFO - 'MOZ_BUILD_DATE': '20160306214709', 21:47:31 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 21:47:31 INFO - 'MOZ_OBJDIR': 'obj-firefox', 21:47:31 INFO - 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 21:47:31 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 21:47:31 INFO - 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 21:47:31 INFO - 'PROPERTIES_FILE': '/builds/slave/m-esr45-l64-asan-0000000000000/buildprops.json', 21:47:31 INFO - 'PWD': '/builds/slave/m-esr45-l64-asan-0000000000000', 21:47:31 INFO - 'SHELL': '/bin/bash', 21:47:31 INFO - 'SHLVL': '1', 21:47:31 INFO - 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 21:47:31 INFO - 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 21:47:31 INFO - 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 21:47:31 INFO - 'SYMBOL_SERVER_USER': 'ffxbld', 21:47:31 INFO - 'TERM': 'linux', 21:47:31 INFO - 'TINDERBOX_OUTPUT': '1', 21:47:31 INFO - 'TMOUT': '86400', 21:47:31 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 21:47:31 INFO - 'TOOLTOOL_HOME': '/builds', 21:47:31 INFO - 'USER': 'cltbld', 21:47:31 INFO - '_': '/tools/buildbot/bin/python'} 21:47:31 INFO - Reporting hg version in use 21:47:31 INFO - command: START 21:47:32 INFO - command: hg -q version 21:47:32 INFO - command: cwd: . 21:47:32 INFO - command: output: 21:47:32 INFO - Mercurial Distributed SCM (version 3.2.1) 21:47:32 INFO - command: END (0.29s elapsed) 21:47:32 INFO - Checking if share extension works 21:47:32 INFO - command: START 21:47:32 INFO - command: hg help share 21:47:32 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 21:47:32 INFO - command: env: {'HGPLAIN': '1'} 21:47:32 INFO - command: END (0.50s elapsed) 21:47:32 INFO - Updating shared repo 21:47:32 INFO - Reporting hg version in use 21:47:32 INFO - command: START 21:47:32 INFO - command: hg -q version 21:47:32 INFO - command: cwd: . 21:47:32 INFO - command: output: 21:47:33 INFO - Mercurial Distributed SCM (version 3.2.1) 21:47:33 INFO - command: END (0.29s elapsed) 21:47:33 INFO - Attempting to initialize clone with bundles 21:47:33 INFO - command: START 21:47:33 INFO - command: hg init /builds/hg-shared/projects/mozilla-esr45 21:47:33 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 21:47:33 INFO - command: output: 21:47:33 INFO - command: END (0.31s elapsed) 21:47:33 INFO - Trying to use bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 21:47:33 INFO - command: START 21:47:33 INFO - command: hg unbundle --traceback https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 21:47:33 INFO - command: cwd: /builds/hg-shared/projects/mozilla-esr45 21:47:33 INFO - command: env: {'HGPLAIN': '1'} 21:57:00 INFO - command: END (567.34s elapsed) 21:57:00 INFO - command: output: 21:57:00 INFO - adding changesets 21:57:00 INFO - adding manifests 21:57:00 INFO - adding file changes 21:57:00 INFO - added 311758 changesets with 1633784 changes to 230781 files (+170 heads) 21:57:00 INFO - (run 'hg heads' to see heads) 21:57:00 INFO - command: START 21:57:00 INFO - command: hg pull --traceback -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde https://hg.mozilla.org/projects/mozilla-esr45 21:57:00 INFO - command: cwd: /builds/hg-shared/projects/mozilla-esr45 21:57:00 INFO - command: env: {'HGPLAIN': '1'} 21:57:01 INFO - Hit exception running hg: 21:57:01 INFO - Traceback (most recent call last): 21:57:01 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 21:57:01 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 21:57:01 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 21:57:01 INFO - raise error 21:57:01 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 21:58:25 INFO - Problem unbundling/pulling from https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 21:58:25 INFO - Traceback (most recent call last): 21:58:25 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 262, in clone 21:58:25 INFO - mirrors=mirrors, revision=revision, branch=branch) 21:58:25 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 391, in pull 21:58:25 INFO - get_hg_output(cmd=cmd, cwd=dest, include_stderr=True) 21:58:25 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 21:58:25 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 21:58:25 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 21:58:25 INFO - raise error 21:58:25 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 21:58:25 INFO - Using bundles failed; falling back to clone 21:58:25 INFO - command: START 21:58:25 INFO - command: hg clone --traceback -U https://hg.mozilla.org/projects/mozilla-esr45 /builds/hg-shared/projects/mozilla-esr45 21:58:25 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 21:58:25 INFO - command: env: {'HGPLAIN': '1'} 21:58:26 INFO - Hit exception running hg: 21:58:26 INFO - Traceback (most recent call last): 21:58:26 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 21:58:26 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 21:58:26 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 21:58:26 INFO - raise error 21:58:26 INFO - CalledProcessError: Command '['hg', 'clone', '--traceback', '-U', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/hg-shared/projects/mozilla-esr45']' returned non-zero exit status 255 21:59:41 INFO - Error updating /builds/slave/m-esr45-l64-asan-0000000000000/build/src from sharedRepo (/builds/hg-shared/projects/mozilla-esr45): 21:59:41 INFO - Attempting to initialize clone with bundles 21:59:41 INFO - command: START 21:59:41 INFO - command: hg init /builds/slave/m-esr45-l64-asan-0000000000000/build/src 21:59:41 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 21:59:41 INFO - command: output: 21:59:41 INFO - command: END (0.31s elapsed) 21:59:41 INFO - Trying to use bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 21:59:41 INFO - command: START 21:59:41 INFO - command: hg unbundle --traceback https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 21:59:41 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 21:59:41 INFO - command: env: {'HGPLAIN': '1'} 22:09:12 INFO - command: END (571.35s elapsed) 22:09:12 INFO - command: output: 22:09:12 INFO - adding changesets 22:09:12 INFO - adding manifests 22:09:12 INFO - adding file changes 22:09:12 INFO - added 311758 changesets with 1633784 changes to 230781 files (+170 heads) 22:09:12 INFO - (run 'hg heads' to see heads) 22:09:12 INFO - command: START 22:09:12 INFO - command: hg pull --traceback -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde https://hg.mozilla.org/projects/mozilla-esr45 22:09:12 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 22:09:12 INFO - command: env: {'HGPLAIN': '1'} 22:09:13 INFO - Hit exception running hg: 22:09:13 INFO - Traceback (most recent call last): 22:09:13 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:09:13 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:09:13 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:09:13 INFO - raise error 22:09:13 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 22:10:38 INFO - Problem unbundling/pulling from https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 22:10:38 INFO - Traceback (most recent call last): 22:10:38 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 262, in clone 22:10:38 INFO - mirrors=mirrors, revision=revision, branch=branch) 22:10:38 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 391, in pull 22:10:38 INFO - get_hg_output(cmd=cmd, cwd=dest, include_stderr=True) 22:10:38 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:10:38 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:10:38 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:10:38 INFO - raise error 22:10:38 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 22:10:38 INFO - Using bundles failed; falling back to clone 22:10:38 INFO - command: START 22:10:38 INFO - command: hg clone --traceback https://hg.mozilla.org/projects/mozilla-esr45 /builds/slave/m-esr45-l64-asan-0000000000000/build/src 22:10:38 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 22:10:38 INFO - command: env: {'HGPLAIN': '1'} 22:10:38 INFO - Hit exception running hg: 22:10:38 INFO - Traceback (most recent call last): 22:10:38 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:10:38 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:10:38 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:10:38 INFO - raise error 22:10:38 INFO - CalledProcessError: Command '['hg', 'clone', '--traceback', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src']' returned non-zero exit status 255 22:11:53 INFO - Traceback (most recent call last): 22:11:53 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py", line 94, in 22:11:53 INFO - autoPurge=options.auto_purge) 22:11:53 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 627, in mercurial 22:11:53 INFO - bundles=bundles, clone_by_rev=clone_by_rev) 22:11:53 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 309, in clone 22:11:53 INFO - get_hg_output(cmd=cmd, include_stderr=True, timeout=timeout) 22:11:53 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:11:53 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:11:53 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:11:53 INFO - raise error 22:11:53 INFO - subprocess.CalledProcessError: Command '['hg', 'clone', '--traceback', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src']' returned non-zero exit status 255 22:11:53 ERROR - Return code: 1 22:11:53 INFO - rmtree: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 22:11:53 INFO - retry: attempt #1 caught exception: Unable to checkout 22:11:53 INFO - retry: Failed, sleeping 60 seconds before retrying 22:12:54 INFO - retry: Calling _get_revision with args: (, '/builds/slave/m-esr45-l64-asan-0000000000000/build/src'), kwargs: {}, attempt #2 22:12:54 INFO - Running command: ['/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', '--bundle', 'https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src'] 22:12:54 INFO - Copy/paste: /builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde --bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg https://hg.mozilla.org/projects/mozilla-esr45 /builds/slave/m-esr45-l64-asan-0000000000000/build/src 22:12:54 INFO - Using env: {'CCACHE_COMPRESS': '1', 22:12:54 INFO - 'CCACHE_DIR': '/builds/ccache', 22:12:54 INFO - 'CCACHE_HASHDIR': '', 22:12:54 INFO - 'CCACHE_UMASK': '002', 22:12:54 INFO - 'DISPLAY': ':2', 22:12:54 INFO - 'G_BROKEN_FILENAMES': '1', 22:12:54 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 22:12:54 INFO - 'HISTCONTROL': 'ignoredups', 22:12:54 INFO - 'HISTSIZE': '1000', 22:12:54 INFO - 'HOME': '/home/cltbld', 22:12:54 INFO - 'HOSTNAME': 'bld-linux64-spot-572.build.releng.usw2.mozilla.com', 22:12:54 INFO - 'LANG': 'en_US.UTF-8', 22:12:54 INFO - 'LC_ALL': 'C', 22:12:54 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 22:12:54 INFO - 'LOGNAME': 'cltbld', 22:12:54 INFO - 'MAIL': '/var/spool/mail/cltbld', 22:12:54 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-esr45-l64-asan-0000000000000/.mozbuild', 22:12:54 INFO - 'MOZ_AUTOMATION': '1', 22:12:54 INFO - 'MOZ_BUILD_DATE': '20160306214709', 22:12:54 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 22:12:54 INFO - 'MOZ_OBJDIR': 'obj-firefox', 22:12:54 INFO - 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 22:12:54 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 22:12:54 INFO - 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 22:12:54 INFO - 'PROPERTIES_FILE': '/builds/slave/m-esr45-l64-asan-0000000000000/buildprops.json', 22:12:54 INFO - 'PWD': '/builds/slave/m-esr45-l64-asan-0000000000000', 22:12:54 INFO - 'SHELL': '/bin/bash', 22:12:54 INFO - 'SHLVL': '1', 22:12:54 INFO - 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 22:12:54 INFO - 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 22:12:54 INFO - 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 22:12:54 INFO - 'SYMBOL_SERVER_USER': 'ffxbld', 22:12:54 INFO - 'TERM': 'linux', 22:12:54 INFO - 'TINDERBOX_OUTPUT': '1', 22:12:54 INFO - 'TMOUT': '86400', 22:12:54 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 22:12:54 INFO - 'TOOLTOOL_HOME': '/builds', 22:12:54 INFO - 'USER': 'cltbld', 22:12:54 INFO - '_': '/tools/buildbot/bin/python'} 22:12:54 INFO - Reporting hg version in use 22:12:54 INFO - command: START 22:12:54 INFO - command: hg -q version 22:12:54 INFO - command: cwd: . 22:12:54 INFO - command: output: 22:12:54 INFO - Mercurial Distributed SCM (version 3.2.1) 22:12:54 INFO - command: END (0.29s elapsed) 22:12:54 INFO - Checking if share extension works 22:12:54 INFO - command: START 22:12:54 INFO - command: hg help share 22:12:54 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 22:12:54 INFO - command: env: {'HGPLAIN': '1'} 22:12:54 INFO - command: END (0.50s elapsed) 22:12:54 INFO - Updating shared repo 22:12:54 INFO - Reporting hg version in use 22:12:54 INFO - command: START 22:12:54 INFO - command: hg -q version 22:12:54 INFO - command: cwd: . 22:12:54 INFO - command: output: 22:12:55 INFO - Mercurial Distributed SCM (version 3.2.1) 22:12:55 INFO - command: END (0.29s elapsed) 22:12:55 INFO - Attempting to initialize clone with bundles 22:12:55 INFO - command: START 22:12:55 INFO - command: hg init /builds/hg-shared/projects/mozilla-esr45 22:12:55 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 22:12:55 INFO - command: output: 22:12:55 INFO - command: END (0.31s elapsed) 22:12:55 INFO - Trying to use bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 22:12:55 INFO - command: START 22:12:55 INFO - command: hg unbundle --traceback https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 22:12:55 INFO - command: cwd: /builds/hg-shared/projects/mozilla-esr45 22:12:55 INFO - command: env: {'HGPLAIN': '1'} 22:22:30 INFO - command: END (574.87s elapsed) 22:22:30 INFO - command: output: 22:22:30 INFO - adding changesets 22:22:30 INFO - adding manifests 22:22:30 INFO - adding file changes 22:22:30 INFO - added 311758 changesets with 1633784 changes to 230781 files (+170 heads) 22:22:30 INFO - (run 'hg heads' to see heads) 22:22:30 INFO - command: START 22:22:30 INFO - command: hg pull --traceback -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde https://hg.mozilla.org/projects/mozilla-esr45 22:22:30 INFO - command: cwd: /builds/hg-shared/projects/mozilla-esr45 22:22:30 INFO - command: env: {'HGPLAIN': '1'} 22:22:30 INFO - Hit exception running hg: 22:22:30 INFO - Traceback (most recent call last): 22:22:30 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:22:30 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:22:30 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:22:30 INFO - raise error 22:22:30 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 22:23:55 INFO - Problem unbundling/pulling from https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 22:23:55 INFO - Traceback (most recent call last): 22:23:55 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 262, in clone 22:23:55 INFO - mirrors=mirrors, revision=revision, branch=branch) 22:23:55 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 391, in pull 22:23:55 INFO - get_hg_output(cmd=cmd, cwd=dest, include_stderr=True) 22:23:55 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:23:55 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:23:55 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:23:55 INFO - raise error 22:23:55 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 22:23:55 INFO - Using bundles failed; falling back to clone 22:23:55 INFO - command: START 22:23:55 INFO - command: hg clone --traceback -U https://hg.mozilla.org/projects/mozilla-esr45 /builds/hg-shared/projects/mozilla-esr45 22:23:55 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 22:23:55 INFO - command: env: {'HGPLAIN': '1'} 22:23:55 INFO - Hit exception running hg: 22:23:55 INFO - Traceback (most recent call last): 22:23:55 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:23:55 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:23:55 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:23:55 INFO - raise error 22:23:55 INFO - CalledProcessError: Command '['hg', 'clone', '--traceback', '-U', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/hg-shared/projects/mozilla-esr45']' returned non-zero exit status 255 22:25:10 INFO - Error updating /builds/slave/m-esr45-l64-asan-0000000000000/build/src from sharedRepo (/builds/hg-shared/projects/mozilla-esr45): 22:25:10 INFO - Attempting to initialize clone with bundles 22:25:10 INFO - command: START 22:25:10 INFO - command: hg init /builds/slave/m-esr45-l64-asan-0000000000000/build/src 22:25:10 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 22:25:10 INFO - command: output: 22:25:11 INFO - command: END (0.31s elapsed) 22:25:11 INFO - Trying to use bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 22:25:11 INFO - command: START 22:25:11 INFO - command: hg unbundle --traceback https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 22:25:11 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 22:25:11 INFO - command: env: {'HGPLAIN': '1'} 22:34:45 INFO - command: END (574.35s elapsed) 22:34:45 INFO - command: output: 22:34:45 INFO - adding changesets 22:34:45 INFO - adding manifests 22:34:45 INFO - adding file changes 22:34:45 INFO - added 311758 changesets with 1633784 changes to 230781 files (+170 heads) 22:34:45 INFO - (run 'hg heads' to see heads) 22:34:45 INFO - command: START 22:34:45 INFO - command: hg pull --traceback -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde https://hg.mozilla.org/projects/mozilla-esr45 22:34:45 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 22:34:45 INFO - command: env: {'HGPLAIN': '1'} 22:34:45 INFO - Hit exception running hg: 22:34:45 INFO - Traceback (most recent call last): 22:34:45 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:34:45 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:34:45 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:34:45 INFO - raise error 22:34:45 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 22:36:10 INFO - Problem unbundling/pulling from https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 22:36:10 INFO - Traceback (most recent call last): 22:36:10 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 262, in clone 22:36:10 INFO - mirrors=mirrors, revision=revision, branch=branch) 22:36:10 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 391, in pull 22:36:10 INFO - get_hg_output(cmd=cmd, cwd=dest, include_stderr=True) 22:36:10 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:36:10 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:36:10 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:36:10 INFO - raise error 22:36:10 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 22:36:10 INFO - Using bundles failed; falling back to clone 22:36:10 INFO - command: START 22:36:10 INFO - command: hg clone --traceback https://hg.mozilla.org/projects/mozilla-esr45 /builds/slave/m-esr45-l64-asan-0000000000000/build/src 22:36:10 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 22:36:10 INFO - command: env: {'HGPLAIN': '1'} 22:36:11 INFO - Hit exception running hg: 22:36:11 INFO - Traceback (most recent call last): 22:36:11 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:36:11 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:36:11 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:36:11 INFO - raise error 22:36:11 INFO - CalledProcessError: Command '['hg', 'clone', '--traceback', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src']' returned non-zero exit status 255 22:37:26 INFO - Traceback (most recent call last): 22:37:26 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py", line 94, in 22:37:26 INFO - autoPurge=options.auto_purge) 22:37:26 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 627, in mercurial 22:37:26 INFO - bundles=bundles, clone_by_rev=clone_by_rev) 22:37:26 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 309, in clone 22:37:26 INFO - get_hg_output(cmd=cmd, include_stderr=True, timeout=timeout) 22:37:26 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:37:26 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:37:26 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:37:26 INFO - raise error 22:37:26 INFO - subprocess.CalledProcessError: Command '['hg', 'clone', '--traceback', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src']' returned non-zero exit status 255 22:37:26 ERROR - Return code: 1 22:37:26 INFO - rmtree: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 22:37:26 INFO - retry: attempt #2 caught exception: Unable to checkout 22:37:26 INFO - retry: Failed, sleeping 120 seconds before retrying 22:39:26 INFO - retry: Calling _get_revision with args: (, '/builds/slave/m-esr45-l64-asan-0000000000000/build/src'), kwargs: {}, attempt #3 22:39:26 INFO - Running command: ['/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', '--bundle', 'https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src'] 22:39:26 INFO - Copy/paste: /builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde --bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg https://hg.mozilla.org/projects/mozilla-esr45 /builds/slave/m-esr45-l64-asan-0000000000000/build/src 22:39:26 INFO - Using env: {'CCACHE_COMPRESS': '1', 22:39:26 INFO - 'CCACHE_DIR': '/builds/ccache', 22:39:26 INFO - 'CCACHE_HASHDIR': '', 22:39:26 INFO - 'CCACHE_UMASK': '002', 22:39:26 INFO - 'DISPLAY': ':2', 22:39:26 INFO - 'G_BROKEN_FILENAMES': '1', 22:39:26 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 22:39:26 INFO - 'HISTCONTROL': 'ignoredups', 22:39:26 INFO - 'HISTSIZE': '1000', 22:39:26 INFO - 'HOME': '/home/cltbld', 22:39:26 INFO - 'HOSTNAME': 'bld-linux64-spot-572.build.releng.usw2.mozilla.com', 22:39:26 INFO - 'LANG': 'en_US.UTF-8', 22:39:26 INFO - 'LC_ALL': 'C', 22:39:26 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 22:39:26 INFO - 'LOGNAME': 'cltbld', 22:39:26 INFO - 'MAIL': '/var/spool/mail/cltbld', 22:39:26 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-esr45-l64-asan-0000000000000/.mozbuild', 22:39:26 INFO - 'MOZ_AUTOMATION': '1', 22:39:26 INFO - 'MOZ_BUILD_DATE': '20160306214709', 22:39:26 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 22:39:26 INFO - 'MOZ_OBJDIR': 'obj-firefox', 22:39:26 INFO - 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 22:39:26 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 22:39:26 INFO - 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 22:39:26 INFO - 'PROPERTIES_FILE': '/builds/slave/m-esr45-l64-asan-0000000000000/buildprops.json', 22:39:26 INFO - 'PWD': '/builds/slave/m-esr45-l64-asan-0000000000000', 22:39:26 INFO - 'SHELL': '/bin/bash', 22:39:26 INFO - 'SHLVL': '1', 22:39:26 INFO - 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 22:39:26 INFO - 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 22:39:26 INFO - 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 22:39:26 INFO - 'SYMBOL_SERVER_USER': 'ffxbld', 22:39:26 INFO - 'TERM': 'linux', 22:39:26 INFO - 'TINDERBOX_OUTPUT': '1', 22:39:26 INFO - 'TMOUT': '86400', 22:39:26 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 22:39:26 INFO - 'TOOLTOOL_HOME': '/builds', 22:39:26 INFO - 'USER': 'cltbld', 22:39:26 INFO - '_': '/tools/buildbot/bin/python'} 22:39:26 INFO - Reporting hg version in use 22:39:26 INFO - command: START 22:39:26 INFO - command: hg -q version 22:39:26 INFO - command: cwd: . 22:39:26 INFO - command: output: 22:39:26 INFO - Mercurial Distributed SCM (version 3.2.1) 22:39:26 INFO - command: END (0.29s elapsed) 22:39:26 INFO - Checking if share extension works 22:39:26 INFO - command: START 22:39:26 INFO - command: hg help share 22:39:26 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 22:39:26 INFO - command: env: {'HGPLAIN': '1'} 22:39:27 INFO - command: END (0.50s elapsed) 22:39:27 INFO - Updating shared repo 22:39:27 INFO - Reporting hg version in use 22:39:27 INFO - command: START 22:39:27 INFO - command: hg -q version 22:39:27 INFO - command: cwd: . 22:39:27 INFO - command: output: 22:39:27 INFO - Mercurial Distributed SCM (version 3.2.1) 22:39:27 INFO - command: END (0.29s elapsed) 22:39:27 INFO - Attempting to initialize clone with bundles 22:39:27 INFO - command: START 22:39:27 INFO - command: hg init /builds/hg-shared/projects/mozilla-esr45 22:39:27 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 22:39:27 INFO - command: output: 22:39:28 INFO - command: END (0.31s elapsed) 22:39:28 INFO - Trying to use bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 22:39:28 INFO - command: START 22:39:28 INFO - command: hg unbundle --traceback https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 22:39:28 INFO - command: cwd: /builds/hg-shared/projects/mozilla-esr45 22:39:28 INFO - command: env: {'HGPLAIN': '1'} 22:49:02 INFO - command: END (574.11s elapsed) 22:49:02 INFO - command: output: 22:49:02 INFO - adding changesets 22:49:02 INFO - adding manifests 22:49:02 INFO - adding file changes 22:49:02 INFO - added 311758 changesets with 1633784 changes to 230781 files (+170 heads) 22:49:02 INFO - (run 'hg heads' to see heads) 22:49:02 INFO - command: START 22:49:02 INFO - command: hg pull --traceback -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde https://hg.mozilla.org/projects/mozilla-esr45 22:49:02 INFO - command: cwd: /builds/hg-shared/projects/mozilla-esr45 22:49:02 INFO - command: env: {'HGPLAIN': '1'} 22:49:02 INFO - Hit exception running hg: 22:49:02 INFO - Traceback (most recent call last): 22:49:02 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:49:02 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:49:02 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:49:02 INFO - raise error 22:49:02 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 22:50:27 INFO - Problem unbundling/pulling from https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 22:50:27 INFO - Traceback (most recent call last): 22:50:27 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 262, in clone 22:50:27 INFO - mirrors=mirrors, revision=revision, branch=branch) 22:50:27 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 391, in pull 22:50:27 INFO - get_hg_output(cmd=cmd, cwd=dest, include_stderr=True) 22:50:27 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:50:27 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:50:27 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:50:27 INFO - raise error 22:50:27 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 22:50:27 INFO - Using bundles failed; falling back to clone 22:50:27 INFO - command: START 22:50:27 INFO - command: hg clone --traceback -U https://hg.mozilla.org/projects/mozilla-esr45 /builds/hg-shared/projects/mozilla-esr45 22:50:27 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 22:50:27 INFO - command: env: {'HGPLAIN': '1'} 22:50:27 INFO - Hit exception running hg: 22:50:27 INFO - Traceback (most recent call last): 22:50:27 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 22:50:27 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 22:50:27 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 22:50:27 INFO - raise error 22:50:27 INFO - CalledProcessError: Command '['hg', 'clone', '--traceback', '-U', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/hg-shared/projects/mozilla-esr45']' returned non-zero exit status 255 22:51:42 INFO - Error updating /builds/slave/m-esr45-l64-asan-0000000000000/build/src from sharedRepo (/builds/hg-shared/projects/mozilla-esr45): 22:51:42 INFO - Attempting to initialize clone with bundles 22:51:42 INFO - command: START 22:51:42 INFO - command: hg init /builds/slave/m-esr45-l64-asan-0000000000000/build/src 22:51:42 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 22:51:42 INFO - command: output: 22:51:43 INFO - command: END (0.32s elapsed) 22:51:43 INFO - Trying to use bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 22:51:43 INFO - command: START 22:51:43 INFO - command: hg unbundle --traceback https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 22:51:43 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 22:51:43 INFO - command: env: {'HGPLAIN': '1'} 23:01:17 INFO - command: END (574.37s elapsed) 23:01:17 INFO - command: output: 23:01:17 INFO - adding changesets 23:01:17 INFO - adding manifests 23:01:17 INFO - adding file changes 23:01:17 INFO - added 311758 changesets with 1633784 changes to 230781 files (+170 heads) 23:01:17 INFO - (run 'hg heads' to see heads) 23:01:17 INFO - command: START 23:01:17 INFO - command: hg pull --traceback -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde https://hg.mozilla.org/projects/mozilla-esr45 23:01:17 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:01:17 INFO - command: env: {'HGPLAIN': '1'} 23:01:18 INFO - Hit exception running hg: 23:01:18 INFO - Traceback (most recent call last): 23:01:18 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:01:18 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:01:18 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:01:18 INFO - raise error 23:01:18 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 23:02:42 INFO - Problem unbundling/pulling from https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 23:02:42 INFO - Traceback (most recent call last): 23:02:42 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 262, in clone 23:02:42 INFO - mirrors=mirrors, revision=revision, branch=branch) 23:02:42 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 391, in pull 23:02:42 INFO - get_hg_output(cmd=cmd, cwd=dest, include_stderr=True) 23:02:42 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:02:42 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:02:42 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:02:42 INFO - raise error 23:02:42 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 23:02:42 INFO - Using bundles failed; falling back to clone 23:02:42 INFO - command: START 23:02:42 INFO - command: hg clone --traceback https://hg.mozilla.org/projects/mozilla-esr45 /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:02:42 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 23:02:42 INFO - command: env: {'HGPLAIN': '1'} 23:02:43 INFO - Hit exception running hg: 23:02:43 INFO - Traceback (most recent call last): 23:02:43 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:02:43 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:02:43 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:02:43 INFO - raise error 23:02:43 INFO - CalledProcessError: Command '['hg', 'clone', '--traceback', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src']' returned non-zero exit status 255 23:03:58 INFO - Traceback (most recent call last): 23:03:58 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py", line 94, in 23:03:58 INFO - autoPurge=options.auto_purge) 23:03:58 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 627, in mercurial 23:03:58 INFO - bundles=bundles, clone_by_rev=clone_by_rev) 23:03:58 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 309, in clone 23:03:58 INFO - get_hg_output(cmd=cmd, include_stderr=True, timeout=timeout) 23:03:58 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:03:58 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:03:58 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:03:58 INFO - raise error 23:03:58 INFO - subprocess.CalledProcessError: Command '['hg', 'clone', '--traceback', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src']' returned non-zero exit status 255 23:03:58 ERROR - Return code: 1 23:03:58 INFO - rmtree: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:03:58 INFO - retry: attempt #3 caught exception: Unable to checkout 23:03:58 INFO - retry: Failed, sleeping 240 seconds before retrying 23:07:58 INFO - retry: Calling _get_revision with args: (, '/builds/slave/m-esr45-l64-asan-0000000000000/build/src'), kwargs: {}, attempt #4 23:07:58 INFO - Running command: ['/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', '--bundle', 'https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src'] 23:07:58 INFO - Copy/paste: /builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde --bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg https://hg.mozilla.org/projects/mozilla-esr45 /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:07:58 INFO - Using env: {'CCACHE_COMPRESS': '1', 23:07:58 INFO - 'CCACHE_DIR': '/builds/ccache', 23:07:58 INFO - 'CCACHE_HASHDIR': '', 23:07:58 INFO - 'CCACHE_UMASK': '002', 23:07:58 INFO - 'DISPLAY': ':2', 23:07:58 INFO - 'G_BROKEN_FILENAMES': '1', 23:07:58 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 23:07:58 INFO - 'HISTCONTROL': 'ignoredups', 23:07:58 INFO - 'HISTSIZE': '1000', 23:07:58 INFO - 'HOME': '/home/cltbld', 23:07:58 INFO - 'HOSTNAME': 'bld-linux64-spot-572.build.releng.usw2.mozilla.com', 23:07:58 INFO - 'LANG': 'en_US.UTF-8', 23:07:58 INFO - 'LC_ALL': 'C', 23:07:58 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 23:07:58 INFO - 'LOGNAME': 'cltbld', 23:07:58 INFO - 'MAIL': '/var/spool/mail/cltbld', 23:07:58 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-esr45-l64-asan-0000000000000/.mozbuild', 23:07:58 INFO - 'MOZ_AUTOMATION': '1', 23:07:58 INFO - 'MOZ_BUILD_DATE': '20160306214709', 23:07:58 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 23:07:58 INFO - 'MOZ_OBJDIR': 'obj-firefox', 23:07:58 INFO - 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 23:07:58 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 23:07:58 INFO - 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 23:07:58 INFO - 'PROPERTIES_FILE': '/builds/slave/m-esr45-l64-asan-0000000000000/buildprops.json', 23:07:58 INFO - 'PWD': '/builds/slave/m-esr45-l64-asan-0000000000000', 23:07:58 INFO - 'SHELL': '/bin/bash', 23:07:58 INFO - 'SHLVL': '1', 23:07:58 INFO - 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 23:07:58 INFO - 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 23:07:58 INFO - 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 23:07:58 INFO - 'SYMBOL_SERVER_USER': 'ffxbld', 23:07:58 INFO - 'TERM': 'linux', 23:07:58 INFO - 'TINDERBOX_OUTPUT': '1', 23:07:58 INFO - 'TMOUT': '86400', 23:07:58 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 23:07:58 INFO - 'TOOLTOOL_HOME': '/builds', 23:07:58 INFO - 'USER': 'cltbld', 23:07:58 INFO - '_': '/tools/buildbot/bin/python'} 23:07:58 INFO - Reporting hg version in use 23:07:58 INFO - command: START 23:07:58 INFO - command: hg -q version 23:07:58 INFO - command: cwd: . 23:07:58 INFO - command: output: 23:07:58 INFO - Mercurial Distributed SCM (version 3.2.1) 23:07:58 INFO - command: END (0.30s elapsed) 23:07:58 INFO - Checking if share extension works 23:07:58 INFO - command: START 23:07:58 INFO - command: hg help share 23:07:58 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 23:07:58 INFO - command: env: {'HGPLAIN': '1'} 23:07:59 INFO - command: END (0.50s elapsed) 23:07:59 INFO - Updating shared repo 23:07:59 INFO - Reporting hg version in use 23:07:59 INFO - command: START 23:07:59 INFO - command: hg -q version 23:07:59 INFO - command: cwd: . 23:07:59 INFO - command: output: 23:07:59 INFO - Mercurial Distributed SCM (version 3.2.1) 23:07:59 INFO - command: END (0.30s elapsed) 23:07:59 INFO - Attempting to initialize clone with bundles 23:07:59 INFO - command: START 23:07:59 INFO - command: hg init /builds/hg-shared/projects/mozilla-esr45 23:07:59 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 23:07:59 INFO - command: output: 23:08:00 INFO - command: END (0.32s elapsed) 23:08:00 INFO - Trying to use bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 23:08:00 INFO - command: START 23:08:00 INFO - command: hg unbundle --traceback https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 23:08:00 INFO - command: cwd: /builds/hg-shared/projects/mozilla-esr45 23:08:00 INFO - command: env: {'HGPLAIN': '1'} 23:17:25 INFO - command: END (565.88s elapsed) 23:17:25 INFO - command: output: 23:17:25 INFO - adding changesets 23:17:25 INFO - adding manifests 23:17:25 INFO - adding file changes 23:17:25 INFO - added 311758 changesets with 1633784 changes to 230781 files (+170 heads) 23:17:25 INFO - (run 'hg heads' to see heads) 23:17:25 INFO - command: START 23:17:25 INFO - command: hg pull --traceback -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde https://hg.mozilla.org/projects/mozilla-esr45 23:17:25 INFO - command: cwd: /builds/hg-shared/projects/mozilla-esr45 23:17:25 INFO - command: env: {'HGPLAIN': '1'} 23:17:26 INFO - Hit exception running hg: 23:17:26 INFO - Traceback (most recent call last): 23:17:26 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:17:26 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:17:26 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:17:26 INFO - raise error 23:17:26 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 23:18:51 INFO - Problem unbundling/pulling from https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 23:18:51 INFO - Traceback (most recent call last): 23:18:51 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 262, in clone 23:18:51 INFO - mirrors=mirrors, revision=revision, branch=branch) 23:18:51 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 391, in pull 23:18:51 INFO - get_hg_output(cmd=cmd, cwd=dest, include_stderr=True) 23:18:51 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:18:51 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:18:51 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:18:51 INFO - raise error 23:18:51 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 23:18:51 INFO - Using bundles failed; falling back to clone 23:18:51 INFO - command: START 23:18:51 INFO - command: hg clone --traceback -U https://hg.mozilla.org/projects/mozilla-esr45 /builds/hg-shared/projects/mozilla-esr45 23:18:51 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 23:18:51 INFO - command: env: {'HGPLAIN': '1'} 23:18:51 INFO - Hit exception running hg: 23:18:51 INFO - Traceback (most recent call last): 23:18:51 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:18:51 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:18:51 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:18:51 INFO - raise error 23:18:51 INFO - CalledProcessError: Command '['hg', 'clone', '--traceback', '-U', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/hg-shared/projects/mozilla-esr45']' returned non-zero exit status 255 23:20:06 INFO - Error updating /builds/slave/m-esr45-l64-asan-0000000000000/build/src from sharedRepo (/builds/hg-shared/projects/mozilla-esr45): 23:20:06 INFO - Attempting to initialize clone with bundles 23:20:06 INFO - command: START 23:20:06 INFO - command: hg init /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:20:06 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 23:20:06 INFO - command: output: 23:20:07 INFO - command: END (0.31s elapsed) 23:20:07 INFO - Trying to use bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 23:20:07 INFO - command: START 23:20:07 INFO - command: hg unbundle --traceback https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 23:20:07 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:20:07 INFO - command: env: {'HGPLAIN': '1'} 23:29:32 INFO - command: END (565.60s elapsed) 23:29:32 INFO - command: output: 23:29:32 INFO - adding changesets 23:29:32 INFO - adding manifests 23:29:32 INFO - adding file changes 23:29:32 INFO - added 311758 changesets with 1633784 changes to 230781 files (+170 heads) 23:29:32 INFO - (run 'hg heads' to see heads) 23:29:32 INFO - command: START 23:29:32 INFO - command: hg pull --traceback -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde https://hg.mozilla.org/projects/mozilla-esr45 23:29:32 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:29:32 INFO - command: env: {'HGPLAIN': '1'} 23:29:33 INFO - Hit exception running hg: 23:29:33 INFO - Traceback (most recent call last): 23:29:33 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:29:33 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:29:33 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:29:33 INFO - raise error 23:29:33 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 23:30:58 INFO - Problem unbundling/pulling from https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 23:30:58 INFO - Traceback (most recent call last): 23:30:58 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 262, in clone 23:30:58 INFO - mirrors=mirrors, revision=revision, branch=branch) 23:30:58 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 391, in pull 23:30:58 INFO - get_hg_output(cmd=cmd, cwd=dest, include_stderr=True) 23:30:58 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:30:58 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:30:58 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:30:58 INFO - raise error 23:30:58 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 23:30:58 INFO - Using bundles failed; falling back to clone 23:30:58 INFO - command: START 23:30:58 INFO - command: hg clone --traceback https://hg.mozilla.org/projects/mozilla-esr45 /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:30:58 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 23:30:58 INFO - command: env: {'HGPLAIN': '1'} 23:30:58 INFO - Hit exception running hg: 23:30:58 INFO - Traceback (most recent call last): 23:30:58 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:30:58 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:30:58 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:30:58 INFO - raise error 23:30:58 INFO - CalledProcessError: Command '['hg', 'clone', '--traceback', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src']' returned non-zero exit status 255 23:32:13 INFO - Traceback (most recent call last): 23:32:13 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py", line 94, in 23:32:13 INFO - autoPurge=options.auto_purge) 23:32:13 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 627, in mercurial 23:32:13 INFO - bundles=bundles, clone_by_rev=clone_by_rev) 23:32:13 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 309, in clone 23:32:13 INFO - get_hg_output(cmd=cmd, include_stderr=True, timeout=timeout) 23:32:13 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:32:13 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:32:13 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:32:13 INFO - raise error 23:32:13 INFO - subprocess.CalledProcessError: Command '['hg', 'clone', '--traceback', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src']' returned non-zero exit status 255 23:32:13 ERROR - Return code: 1 23:32:13 INFO - rmtree: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:32:13 INFO - retry: attempt #4 caught exception: Unable to checkout 23:32:13 INFO - retry: Failed, sleeping 300 seconds before retrying 23:37:13 INFO - retry: Calling _get_revision with args: (, '/builds/slave/m-esr45-l64-asan-0000000000000/build/src'), kwargs: {}, attempt #5 23:37:13 INFO - Running command: ['/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', '--bundle', 'https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src'] 23:37:13 INFO - Copy/paste: /builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde --bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg https://hg.mozilla.org/projects/mozilla-esr45 /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:37:13 INFO - Using env: {'CCACHE_COMPRESS': '1', 23:37:13 INFO - 'CCACHE_DIR': '/builds/ccache', 23:37:13 INFO - 'CCACHE_HASHDIR': '', 23:37:13 INFO - 'CCACHE_UMASK': '002', 23:37:13 INFO - 'DISPLAY': ':2', 23:37:13 INFO - 'G_BROKEN_FILENAMES': '1', 23:37:13 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 23:37:13 INFO - 'HISTCONTROL': 'ignoredups', 23:37:13 INFO - 'HISTSIZE': '1000', 23:37:13 INFO - 'HOME': '/home/cltbld', 23:37:13 INFO - 'HOSTNAME': 'bld-linux64-spot-572.build.releng.usw2.mozilla.com', 23:37:13 INFO - 'LANG': 'en_US.UTF-8', 23:37:13 INFO - 'LC_ALL': 'C', 23:37:13 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 23:37:13 INFO - 'LOGNAME': 'cltbld', 23:37:13 INFO - 'MAIL': '/var/spool/mail/cltbld', 23:37:13 INFO - 'MOZBUILD_STATE_PATH': '/builds/slave/m-esr45-l64-asan-0000000000000/.mozbuild', 23:37:13 INFO - 'MOZ_AUTOMATION': '1', 23:37:13 INFO - 'MOZ_BUILD_DATE': '20160306214709', 23:37:13 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 23:37:13 INFO - 'MOZ_OBJDIR': 'obj-firefox', 23:37:13 INFO - 'MOZ_SYMBOLS_EXTRA_BUILDID': 'linux64-asan', 23:37:13 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 23:37:13 INFO - 'POST_SYMBOL_UPLOAD_CMD': '/usr/local/bin/post-symbol-upload.py', 23:37:13 INFO - 'PROPERTIES_FILE': '/builds/slave/m-esr45-l64-asan-0000000000000/buildprops.json', 23:37:13 INFO - 'PWD': '/builds/slave/m-esr45-l64-asan-0000000000000', 23:37:13 INFO - 'SHELL': '/bin/bash', 23:37:13 INFO - 'SHLVL': '1', 23:37:13 INFO - 'SYMBOL_SERVER_HOST': 'symbolpush.mozilla.org', 23:37:13 INFO - 'SYMBOL_SERVER_PATH': '/mnt/netapp/breakpad/symbols_ffx/', 23:37:13 INFO - 'SYMBOL_SERVER_SSH_KEY': '/home/mock_mozilla/.ssh/ffxbld_rsa', 23:37:13 INFO - 'SYMBOL_SERVER_USER': 'ffxbld', 23:37:13 INFO - 'TERM': 'linux', 23:37:13 INFO - 'TINDERBOX_OUTPUT': '1', 23:37:13 INFO - 'TMOUT': '86400', 23:37:13 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 23:37:13 INFO - 'TOOLTOOL_HOME': '/builds', 23:37:13 INFO - 'USER': 'cltbld', 23:37:13 INFO - '_': '/tools/buildbot/bin/python'} 23:37:13 INFO - Reporting hg version in use 23:37:13 INFO - command: START 23:37:13 INFO - command: hg -q version 23:37:13 INFO - command: cwd: . 23:37:13 INFO - command: output: 23:37:14 INFO - Mercurial Distributed SCM (version 3.2.1) 23:37:14 INFO - command: END (0.29s elapsed) 23:37:14 INFO - Checking if share extension works 23:37:14 INFO - command: START 23:37:14 INFO - command: hg help share 23:37:14 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 23:37:14 INFO - command: env: {'HGPLAIN': '1'} 23:37:14 INFO - command: END (0.50s elapsed) 23:37:14 INFO - Updating shared repo 23:37:14 INFO - Reporting hg version in use 23:37:14 INFO - command: START 23:37:14 INFO - command: hg -q version 23:37:14 INFO - command: cwd: . 23:37:14 INFO - command: output: 23:37:14 INFO - Mercurial Distributed SCM (version 3.2.1) 23:37:14 INFO - command: END (0.29s elapsed) 23:37:14 INFO - Attempting to initialize clone with bundles 23:37:14 INFO - command: START 23:37:14 INFO - command: hg init /builds/hg-shared/projects/mozilla-esr45 23:37:14 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 23:37:14 INFO - command: output: 23:37:15 INFO - command: END (0.31s elapsed) 23:37:15 INFO - Trying to use bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 23:37:15 INFO - command: START 23:37:15 INFO - command: hg unbundle --traceback https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 23:37:15 INFO - command: cwd: /builds/hg-shared/projects/mozilla-esr45 23:37:15 INFO - command: env: {'HGPLAIN': '1'} 23:46:41 INFO - command: END (566.08s elapsed) 23:46:41 INFO - command: output: 23:46:41 INFO - adding changesets 23:46:41 INFO - adding manifests 23:46:41 INFO - adding file changes 23:46:41 INFO - added 311758 changesets with 1633784 changes to 230781 files (+170 heads) 23:46:41 INFO - (run 'hg heads' to see heads) 23:46:41 INFO - command: START 23:46:41 INFO - command: hg pull --traceback -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde https://hg.mozilla.org/projects/mozilla-esr45 23:46:41 INFO - command: cwd: /builds/hg-shared/projects/mozilla-esr45 23:46:41 INFO - command: env: {'HGPLAIN': '1'} 23:46:41 INFO - Hit exception running hg: 23:46:41 INFO - Traceback (most recent call last): 23:46:41 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:46:41 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:46:41 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:46:41 INFO - raise error 23:46:41 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 23:48:06 INFO - Problem unbundling/pulling from https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 23:48:06 INFO - Traceback (most recent call last): 23:48:06 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 262, in clone 23:48:06 INFO - mirrors=mirrors, revision=revision, branch=branch) 23:48:06 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 391, in pull 23:48:06 INFO - get_hg_output(cmd=cmd, cwd=dest, include_stderr=True) 23:48:06 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:48:06 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:48:06 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:48:06 INFO - raise error 23:48:06 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 23:48:06 INFO - Using bundles failed; falling back to clone 23:48:06 INFO - command: START 23:48:06 INFO - command: hg clone --traceback -U https://hg.mozilla.org/projects/mozilla-esr45 /builds/hg-shared/projects/mozilla-esr45 23:48:06 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 23:48:06 INFO - command: env: {'HGPLAIN': '1'} 23:48:06 INFO - Hit exception running hg: 23:48:06 INFO - Traceback (most recent call last): 23:48:06 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:48:06 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:48:06 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:48:06 INFO - raise error 23:48:06 INFO - CalledProcessError: Command '['hg', 'clone', '--traceback', '-U', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/hg-shared/projects/mozilla-esr45']' returned non-zero exit status 255 23:49:21 INFO - Error updating /builds/slave/m-esr45-l64-asan-0000000000000/build/src from sharedRepo (/builds/hg-shared/projects/mozilla-esr45): 23:49:21 INFO - Attempting to initialize clone with bundles 23:49:21 INFO - command: START 23:49:21 INFO - command: hg init /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:49:21 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 23:49:21 INFO - command: output: 23:49:22 INFO - command: END (0.31s elapsed) 23:49:22 INFO - Trying to use bundle https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 23:49:22 INFO - command: START 23:49:22 INFO - command: hg unbundle --traceback https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 23:49:22 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:49:22 INFO - command: env: {'HGPLAIN': '1'} 23:59:02 INFO - command: END (580.13s elapsed) 23:59:02 INFO - command: output: 23:59:02 INFO - adding changesets 23:59:02 INFO - adding manifests 23:59:02 INFO - adding file changes 23:59:02 INFO - added 311758 changesets with 1633784 changes to 230781 files (+170 heads) 23:59:02 INFO - (run 'hg heads' to see heads) 23:59:02 INFO - command: START 23:59:02 INFO - command: hg pull --traceback -r 7b2dfb80cd13d31b5653155b87c66c87dab8bdde https://hg.mozilla.org/projects/mozilla-esr45 23:59:02 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 23:59:02 INFO - command: env: {'HGPLAIN': '1'} 23:59:02 INFO - Hit exception running hg: 23:59:02 INFO - Traceback (most recent call last): 23:59:02 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 23:59:02 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 23:59:02 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 23:59:02 INFO - raise error 23:59:02 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 00:00:27 INFO - Problem unbundling/pulling from https://ftp-ssl.mozilla.org/pub/mozilla.org/firefox/bundles/mozilla-esr45.hg 00:00:27 INFO - Traceback (most recent call last): 00:00:27 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 262, in clone 00:00:27 INFO - mirrors=mirrors, revision=revision, branch=branch) 00:00:27 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 391, in pull 00:00:27 INFO - get_hg_output(cmd=cmd, cwd=dest, include_stderr=True) 00:00:27 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 00:00:27 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 00:00:27 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 00:00:27 INFO - raise error 00:00:27 INFO - CalledProcessError: Command '['hg', 'pull', '--traceback', '-r', '7b2dfb80cd13d31b5653155b87c66c87dab8bdde', 'https://hg.mozilla.org/projects/mozilla-esr45']' returned non-zero exit status 255 00:00:27 INFO - Using bundles failed; falling back to clone 00:00:27 INFO - command: START 00:00:27 INFO - command: hg clone --traceback https://hg.mozilla.org/projects/mozilla-esr45 /builds/slave/m-esr45-l64-asan-0000000000000/build/src 00:00:27 INFO - command: cwd: /builds/slave/m-esr45-l64-asan-0000000000000 00:00:27 INFO - command: env: {'HGPLAIN': '1'} 00:00:28 INFO - Hit exception running hg: 00:00:28 INFO - Traceback (most recent call last): 00:00:28 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 00:00:28 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 00:00:28 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 00:00:28 INFO - raise error 00:00:28 INFO - CalledProcessError: Command '['hg', 'clone', '--traceback', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src']' returned non-zero exit status 255 00:01:43 INFO - Traceback (most recent call last): 00:01:43 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/hgtool.py", line 94, in 00:01:43 INFO - autoPurge=options.auto_purge) 00:01:43 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 627, in mercurial 00:01:43 INFO - bundles=bundles, clone_by_rev=clone_by_rev) 00:01:43 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 309, in clone 00:01:43 INFO - get_hg_output(cmd=cmd, include_stderr=True, timeout=timeout) 00:01:43 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/hg.py", line 99, in get_hg_output 00:01:43 INFO - return get_output(['hg'] + cmd, timeout=timeout, env=env, **kwargs) 00:01:43 INFO - File "/builds/slave/m-esr45-l64-asan-0000000000000/build/tools/buildfarm/utils/../../lib/python/util/commands.py", line 207, in get_output 00:01:43 INFO - raise error 00:01:43 INFO - subprocess.CalledProcessError: Command '['hg', 'clone', '--traceback', 'https://hg.mozilla.org/projects/mozilla-esr45', '/builds/slave/m-esr45-l64-asan-0000000000000/build/src']' returned non-zero exit status 255 00:01:43 ERROR - Return code: 1 00:01:43 INFO - rmtree: /builds/slave/m-esr45-l64-asan-0000000000000/build/src 00:01:43 INFO - retry: attempt #5 caught exception: Unable to checkout 00:01:43 FATAL - Automation Error: Can't checkout https://hg.mozilla.org/projects/mozilla-esr45! 00:01:43 FATAL - Caught exception: Unable to checkout 00:01:43 FATAL - Caught exception: Unable to checkout 00:01:43 FATAL - Caught exception: Unable to checkout 00:01:43 FATAL - Caught exception: Unable to checkout 00:01:43 FATAL - Caught exception: Unable to checkout 00:01:43 FATAL - Running post_fatal callback... 00:01:43 ERROR - setting return code to 2 because fatal was called 00:01:43 WARNING - setting return code to 2 00:01:43 FATAL - Exiting -1 00:01:43 INFO - Running post-action listener: influxdb_recording_post_action 00:01:43 INFO - Resetting dropped connection: goldiewilson-onepointtwentyone-1.c.influxdb.com 00:01:43 INFO - Running post-run listener: _summarize 00:01:43 ERROR - # TBPL FAILURE # 00:01:43 INFO - ##### 00:01:43 INFO - ##### FxDesktopBuild summary: 00:01:43 INFO - ##### 00:01:43 ERROR - # TBPL FAILURE # program finished with exit code 255 elapsedTime=8061.961128 ========= master_lag: 0.02 ========= ========= Finished '/tools/buildbot/bin/python scripts/scripts/fx_desktop_build.py ...' failed (results: 2, elapsed: 2 hrs, 14 mins, 21 secs) (at 2016-03-07 00:01:43.565234) ========= ========= Started set props: buildid stage_platform builduid (results: 0, elapsed: 0 secs) (at 2016-03-07 00:01:43.568263) ========= bash -c 'for file in `ls -1`; do cat $file; done' in dir /builds/slave/m-esr45-l64-asan-0000000000000/properties (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'for file in `ls -1`; do cat $file; done'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-572.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-esr45-l64-asan-0000000000000/properties SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False buildid:20160306214709 builduid:e2011416bc11493d8c73ebec62bca233 stage_platform:linux64-asan program finished with exit code 0 elapsedTime=0.006579 buildid: '20160306214709' stage_platform: 'linux64-asan' builduid: 'e2011416bc11493d8c73ebec62bca233' ========= master_lag: 0.05 ========= ========= Finished set props: buildid stage_platform builduid (results: 0, elapsed: 0 secs) (at 2016-03-07 00:01:43.621512) ========= ========= Started 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2016-03-07 00:01:43.621824) ========= rm -f oauth.txt in dir /builds/slave/m-esr45-l64-asan-0000000000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'oauth.txt'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-572.build.releng.usw2.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/m-esr45-l64-asan-0000000000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002694 ========= master_lag: 0.04 ========= ========= Finished 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2016-03-07 00:01:43.668679) ========= ========= Started reboot skipped (results: 3, elapsed: 0 secs) (at 2016-03-07 00:01:43.669003) ========= ========= Finished reboot skipped (results: 3, elapsed: 0 secs) (at 2016-03-07 00:01:43.669269) ========= ========= Total master_lag: 0.38 =========