builder: fx-team_win8_64_test-web-platform-tests-5 slave: t-w864-ix-175 starttime: 1461255578.94 results: failure (2) buildid: 20160421064704 builduid: e66f5047306d4b99bf31a3312915996b revision: baa84a5b4465238deaf0eb1ba28ec7fd38154ef6 ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2016-04-21 09:19:38.939436) ========= master: http://buildbot-master111.bb.releng.scl3.mozilla.com:8201/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2016-04-21 09:19:38.940022) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-04-21 09:19:38.940322) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2016-04-21 09:19:39.025291) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 5 secs) (at 2016-04-21 09:19:39.025713) ========= 'bash' '-c' 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py' in dir C:\slave\test\. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'wget -Oarchiver_client.py --no-check-certificate --tries=10 --waitretry=3 https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py'] environment: ALLUSERSPROFILE=C:\ProgramData APPDATA=C:\Users\cltbld.T-W864-IX-175\AppData\Roaming COMMONPROGRAMFILES=C:\Program Files (x86)\Common Files COMMONPROGRAMFILES(X86)=C:\Program Files (x86)\Common Files COMMONPROGRAMW6432=C:\Program Files\Common Files COMPUTERNAME=T-W864-IX-175 COMSPEC=C:\windows\system32\cmd.exe DCLOCATION=SCL3 DNSSUFFIX=wintest.releng.scl3.mozilla.com FP_NO_HOST_CHECK=NO HOMEDRIVE=C: HOMEPATH=\Users\cltbld.T-W864-IX-175 KTS_HOME=C:\Program Files\KTS KTS_VERSION=1.19c LOCALAPPDATA=C:\Users\cltbld.T-W864-IX-175\AppData\Local LOGONSERVER=\\T-W864-IX-175 MONDIR=C:\Monitor_config\ MOZBUILDDIR=C:\mozilla-build\ NUMBER_OF_PROCESSORS=8 OS=Windows_NT OURDRIVE=C: PATH=C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\mozilla-build\python27;C:\mozilla-build\python27\Scripts;C:\mozilla-build\msys\bin;C:\mozilla-build\vim\vim72;C:\mozilla-build\wget;C:\mozilla-build\info-zip;C:\CoreUtils\bin;C:\mozilla-build\buildbotve\scripts PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PROCESSOR_ARCHITECTURE=x86 PROCESSOR_ARCHITEW6432=AMD64 PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel PROCESSOR_LEVEL=6 PROCESSOR_REVISION=1e05 PROGRAMDATA=C:\ProgramData PROGRAMFILES=C:\Program Files (x86) PROGRAMFILES(X86)=C:\Program Files (x86) PROGRAMW6432=C:\Program Files PROMPT=$P$G PSMODULEPATH=C:\windows\system32\WindowsPowerShell\v1.0\Modules\ PUBLIC=C:\Users\Public PWD=C:\slave\test RUNLOGFILE=C:\slave\\runslave.log SLAVEDIR=C:\slave\ SYSTEMDRIVE=C: SYSTEMROOT=C:\windows TEMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp TEST1=testie TMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp USERDOMAIN=T-W864-IX-175 USERDOMAIN_ROAMINGPROFILE=T-W864-IX-175 USERNAME=cltbld USERPROFILE=C:\Users\cltbld.T-W864-IX-175 WINDIR=C:\windows using PTY: False --09:19:40-- https://hg.mozilla.org/build/tools/raw-file/default/buildfarm/utils/archiver_client.py => `archiver_client.py' Resolving hg.mozilla.org... 63.245.215.102, 63.245.215.25 Connecting to hg.mozilla.org|63.245.215.102|:443... connected. HTTP request sent, awaiting response... 200 Script output follows Length: 12,141 (12K) [text/x-python] 0K .......... . 100% 2.45 GB/s 09:19:41 (2.45 GB/s) - `archiver_client.py' saved [12141/12141] program finished with exit code 0 elapsedTime=1.397000 ========= master_lag: 4.51 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 5 secs) (at 2016-04-21 09:19:44.932238) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 3 secs) (at 2016-04-21 09:19:44.932576) ========= 'rm' '-rf' 'scripts' 'properties' in dir C:\slave\test\. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: ALLUSERSPROFILE=C:\ProgramData APPDATA=C:\Users\cltbld.T-W864-IX-175\AppData\Roaming COMMONPROGRAMFILES=C:\Program Files (x86)\Common Files COMMONPROGRAMFILES(X86)=C:\Program Files (x86)\Common Files COMMONPROGRAMW6432=C:\Program Files\Common Files COMPUTERNAME=T-W864-IX-175 COMSPEC=C:\windows\system32\cmd.exe DCLOCATION=SCL3 DNSSUFFIX=wintest.releng.scl3.mozilla.com FP_NO_HOST_CHECK=NO HOMEDRIVE=C: HOMEPATH=\Users\cltbld.T-W864-IX-175 KTS_HOME=C:\Program Files\KTS KTS_VERSION=1.19c LOCALAPPDATA=C:\Users\cltbld.T-W864-IX-175\AppData\Local LOGONSERVER=\\T-W864-IX-175 MONDIR=C:\Monitor_config\ MOZBUILDDIR=C:\mozilla-build\ NUMBER_OF_PROCESSORS=8 OS=Windows_NT OURDRIVE=C: PATH=C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\mozilla-build\python27;C:\mozilla-build\python27\Scripts;C:\mozilla-build\msys\bin;C:\mozilla-build\vim\vim72;C:\mozilla-build\wget;C:\mozilla-build\info-zip;C:\CoreUtils\bin;C:\mozilla-build\buildbotve\scripts PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PROCESSOR_ARCHITECTURE=x86 PROCESSOR_ARCHITEW6432=AMD64 PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel PROCESSOR_LEVEL=6 PROCESSOR_REVISION=1e05 PROGRAMDATA=C:\ProgramData PROGRAMFILES=C:\Program Files (x86) PROGRAMFILES(X86)=C:\Program Files (x86) PROGRAMW6432=C:\Program Files PROMPT=$P$G PSMODULEPATH=C:\windows\system32\WindowsPowerShell\v1.0\Modules\ PUBLIC=C:\Users\Public PWD=C:\slave\test RUNLOGFILE=C:\slave\\runslave.log SLAVEDIR=C:\slave\ SYSTEMDRIVE=C: SYSTEMROOT=C:\windows TEMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp TEST1=testie TMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp USERDOMAIN=T-W864-IX-175 USERDOMAIN_ROAMINGPROFILE=T-W864-IX-175 USERNAME=cltbld USERPROFILE=C:\Users\cltbld.T-W864-IX-175 WINDIR=C:\windows using PTY: False program finished with exit code 0 elapsedTime=3.410000 ========= master_lag: 0.02 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 3 secs) (at 2016-04-21 09:19:48.362500) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 1 secs) (at 2016-04-21 09:19:48.362892) ========= 'bash' '-c' u'python archiver_client.py mozharness --repo integration/fx-team --rev baa84a5b4465238deaf0eb1ba28ec7fd38154ef6 --destination scripts --debug' in dir C:\slave\test\. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', u'python archiver_client.py mozharness --repo integration/fx-team --rev baa84a5b4465238deaf0eb1ba28ec7fd38154ef6 --destination scripts --debug'] environment: ALLUSERSPROFILE=C:\ProgramData APPDATA=C:\Users\cltbld.T-W864-IX-175\AppData\Roaming COMMONPROGRAMFILES=C:\Program Files (x86)\Common Files COMMONPROGRAMFILES(X86)=C:\Program Files (x86)\Common Files COMMONPROGRAMW6432=C:\Program Files\Common Files COMPUTERNAME=T-W864-IX-175 COMSPEC=C:\windows\system32\cmd.exe DCLOCATION=SCL3 DNSSUFFIX=wintest.releng.scl3.mozilla.com FP_NO_HOST_CHECK=NO HOMEDRIVE=C: HOMEPATH=\Users\cltbld.T-W864-IX-175 KTS_HOME=C:\Program Files\KTS KTS_VERSION=1.19c LOCALAPPDATA=C:\Users\cltbld.T-W864-IX-175\AppData\Local LOGONSERVER=\\T-W864-IX-175 MONDIR=C:\Monitor_config\ MOZBUILDDIR=C:\mozilla-build\ NUMBER_OF_PROCESSORS=8 OS=Windows_NT OURDRIVE=C: PATH=C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\mozilla-build\python27;C:\mozilla-build\python27\Scripts;C:\mozilla-build\msys\bin;C:\mozilla-build\vim\vim72;C:\mozilla-build\wget;C:\mozilla-build\info-zip;C:\CoreUtils\bin;C:\mozilla-build\buildbotve\scripts PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PROCESSOR_ARCHITECTURE=x86 PROCESSOR_ARCHITEW6432=AMD64 PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel PROCESSOR_LEVEL=6 PROCESSOR_REVISION=1e05 PROGRAMDATA=C:\ProgramData PROGRAMFILES=C:\Program Files (x86) PROGRAMFILES(X86)=C:\Program Files (x86) PROGRAMW6432=C:\Program Files PROMPT=$P$G PSMODULEPATH=C:\windows\system32\WindowsPowerShell\v1.0\Modules\ PUBLIC=C:\Users\Public PWD=C:\slave\test RUNLOGFILE=C:\slave\\runslave.log SLAVEDIR=C:\slave\ SYSTEMDRIVE=C: SYSTEMROOT=C:\windows TEMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp TEST1=testie TMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp USERDOMAIN=T-W864-IX-175 USERDOMAIN_ROAMINGPROFILE=T-W864-IX-175 USERNAME=cltbld USERPROFILE=C:\Users\cltbld.T-W864-IX-175 WINDIR=C:\windows using PTY: False 2016-04-21 09:19:49,513 truncating revision to first 12 chars 2016-04-21 09:19:49,513 Setting DEBUG logging. 2016-04-21 09:19:49,513 attempt 1/10 2016-04-21 09:19:49,513 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/integration/fx-team/baa84a5b4465?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2016-04-21 09:19:50,292 unpacking tar archive at: fx-team-baa84a5b4465/testing/mozharness/ program finished with exit code 0 elapsedTime=1.498000 ========= master_lag: 0.05 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 1 secs) (at 2016-04-21 09:19:49.910313) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-04-21 09:19:49.910671) ========= script_repo_revision: baa84a5b4465238deaf0eb1ba28ec7fd38154ef6 ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2016-04-21 09:19:49.911117) ========= ========= Started downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2016-04-21 09:19:49.911391) ========= ========= Finished downloading to oauth.txt (results: 0, elapsed: 0 secs) (at 2016-04-21 09:19:49.924979) ========= ========= Started 'c:/mozilla-build/python27/python -u ...' failed (results: 2, elapsed: 3 mins, 15 secs) (at 2016-04-21 09:19:49.925552) ========= 'c:/mozilla-build/python27/python' '-u' 'scripts/scripts/web_platform_tests.py' '--cfg' 'web_platform_tests/prod_config_windows.py' '--test-type=testharness' '--total-chunks' '5' '--this-chunk' '5' '--blob-upload-branch' 'fx-team' '--download-symbols' 'ondemand' in dir C:\slave\test\. (timeout 1800 secs) (maxTime 7200 secs) watching logfiles {} argv: ['c:/mozilla-build/python27/python', '-u', 'scripts/scripts/web_platform_tests.py', '--cfg', 'web_platform_tests/prod_config_windows.py', '--test-type=testharness', '--total-chunks', '5', '--this-chunk', '5', '--blob-upload-branch', 'fx-team', '--download-symbols', 'ondemand'] environment: ALLUSERSPROFILE=C:\ProgramData APPDATA=C:\Users\cltbld.T-W864-IX-175\AppData\Roaming COMMONPROGRAMFILES=C:\Program Files (x86)\Common Files COMMONPROGRAMFILES(X86)=C:\Program Files (x86)\Common Files COMMONPROGRAMW6432=C:\Program Files\Common Files COMPUTERNAME=T-W864-IX-175 COMSPEC=C:\windows\system32\cmd.exe DCLOCATION=SCL3 DNSSUFFIX=wintest.releng.scl3.mozilla.com FP_NO_HOST_CHECK=NO HOMEDRIVE=C: HOMEPATH=\Users\cltbld.T-W864-IX-175 KTS_HOME=C:\Program Files\KTS KTS_VERSION=1.19c LOCALAPPDATA=C:\Users\cltbld.T-W864-IX-175\AppData\Local LOGONSERVER=\\T-W864-IX-175 MONDIR=C:\Monitor_config\ MOZBUILDDIR=C:\mozilla-build\ MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_HIDE_RESULTS_TABLE=1 MOZ_NO_REMOTE=1 NO_EM_RESTART=1 NO_FAIL_ON_TEST_ERRORS=1 NUMBER_OF_PROCESSORS=8 OS=Windows_NT OURDRIVE=C: PATH=C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\mozilla-build\python27;C:\mozilla-build\python27\Scripts;C:\mozilla-build\msys\bin;C:\mozilla-build\vim\vim72;C:\mozilla-build\wget;C:\mozilla-build\info-zip;C:\CoreUtils\bin;C:\mozilla-build\buildbotve\scripts PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PROCESSOR_ARCHITECTURE=x86 PROCESSOR_ARCHITEW6432=AMD64 PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel PROCESSOR_LEVEL=6 PROCESSOR_REVISION=1e05 PROGRAMDATA=C:\ProgramData PROGRAMFILES=C:\Program Files (x86) PROGRAMFILES(X86)=C:\Program Files (x86) PROGRAMW6432=C:\Program Files PROMPT=$P$G PROPERTIES_FILE=C:\slave\test/buildprops.json PSMODULEPATH=C:\windows\system32\WindowsPowerShell\v1.0\Modules\ PUBLIC=C:\Users\Public PWD=C:\slave\test RUNLOGFILE=C:\slave\\runslave.log SLAVEDIR=C:\slave\ SYSTEMDRIVE=C: SYSTEMROOT=C:\windows TEMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp TEST1=testie TMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp USERDOMAIN=T-W864-IX-175 USERDOMAIN_ROAMINGPROFILE=T-W864-IX-175 USERNAME=cltbld USERPROFILE=C:\Users\cltbld.T-W864-IX-175 WINDIR=C:\windows XPCOM_DEBUG_BREAK=warn using PTY: False 09:19:51 INFO - MultiFileLogger online at 20160421 09:19:51 in C:\slave\test 09:19:51 INFO - Run as scripts/scripts/web_platform_tests.py --cfg web_platform_tests/prod_config_windows.py --test-type=testharness --total-chunks 5 --this-chunk 5 --blob-upload-branch fx-team --download-symbols ondemand 09:19:51 INFO - Dumping config to C:\slave\test\logs\localconfig.json. 09:19:51 INFO - {'append_to_log': False, 09:19:51 INFO - 'base_work_dir': 'C:\\slave\\test', 09:19:51 INFO - 'blob_upload_branch': 'fx-team', 09:19:51 INFO - 'blob_uploader_auth_file': 'C:\\slave\\test\\oauth.txt', 09:19:51 INFO - 'buildbot_json_path': 'buildprops.json', 09:19:51 INFO - 'config_files': ('web_platform_tests/prod_config_windows.py',), 09:19:51 INFO - 'default_blob_upload_servers': ('https://blobupload.elasticbeanstalk.com',), 09:19:51 INFO - 'download_minidump_stackwalk': True, 09:19:51 INFO - 'download_symbols': 'ondemand', 09:19:51 INFO - 'e10s': False, 09:19:51 INFO - 'exes': {'hg': 'c:/mozilla-build/hg/hg', 09:19:51 INFO - 'mozinstall': ('C:\\slave\\test/build/venv/scripts/python', 09:19:51 INFO - 'C:\\slave\\test/build/venv/scripts/mozinstall-script.py'), 09:19:51 INFO - 'python': 'c:\\mozilla-build\\python27\\python.exe', 09:19:51 INFO - 'tooltool.py': ('c:\\mozilla-build\\python27\\python.exe', 09:19:51 INFO - 'C:/mozilla-build/tooltool.py'), 09:19:51 INFO - 'virtualenv': ('c:\\mozilla-build\\python27\\python.exe', 09:19:51 INFO - 'c:/mozilla-build/buildbotve/virtualenv.py')}, 09:19:51 INFO - 'find_links': ('http://pypi.pvt.build.mozilla.org/pub', 09:19:51 INFO - 'http://pypi.pub.build.mozilla.org/pub'), 09:19:51 INFO - 'log_level': 'info', 09:19:51 INFO - 'log_to_console': True, 09:19:51 INFO - 'opt_config_files': (), 09:19:51 INFO - 'options': ('--prefs-root=%(test_path)s/prefs', 09:19:51 INFO - '--processes=1', 09:19:51 INFO - '--config=%(test_path)s/wptrunner.ini', 09:19:51 INFO - '--ca-cert-path=%(test_path)s/certs/cacert.pem', 09:19:51 INFO - '--host-key-path=%(test_path)s/certs/web-platform.test.key', 09:19:51 INFO - '--host-cert-path=%(test_path)s/certs/web-platform.test.pem', 09:19:51 INFO - '--certutil-binary=%(test_install_path)s/bin/certutil'), 09:19:51 INFO - 'pip_index': False, 09:19:51 INFO - 'require_test_zip': True, 09:19:51 INFO - 'test_type': ('testharness',), 09:19:51 INFO - 'this_chunk': '5', 09:19:51 INFO - 'total_chunks': '5', 09:19:51 INFO - 'virtualenv_path': 'venv', 09:19:51 INFO - 'volatile_config': {'actions': None, 'add_actions': None, 'no_actions': None}, 09:19:51 INFO - 'work_dir': 'build'} 09:19:51 INFO - ##### 09:19:51 INFO - ##### Running clobber step. 09:19:51 INFO - ##### 09:19:51 INFO - Running pre-action listener: _resource_record_pre_action 09:19:51 INFO - Running main action method: clobber 09:19:51 INFO - rmtree: C:\slave\test\build 09:19:51 INFO - Using _rmtree_windows ... 09:19:51 INFO - retry: Calling _rmtree_windows with args: ('C:\\slave\\test\\build',), kwargs: {}, attempt #1 09:21:02 INFO - Running post-action listener: _resource_record_post_action 09:21:02 INFO - ##### 09:21:02 INFO - ##### Running read-buildbot-config step. 09:21:02 INFO - ##### 09:21:02 INFO - Running pre-action listener: _resource_record_pre_action 09:21:02 INFO - Running main action method: read_buildbot_config 09:21:02 INFO - Using buildbot properties: 09:21:02 INFO - { 09:21:02 INFO - "project": "", 09:21:02 INFO - "product": "firefox", 09:21:02 INFO - "script_repo_revision": "production", 09:21:02 INFO - "scheduler": "tests-fx-team-win8_64-opt-unittest", 09:21:02 INFO - "repository": "", 09:21:02 INFO - "buildername": "Windows 8 64-bit fx-team opt test web-platform-tests-5", 09:21:02 INFO - "buildid": "20160421064704", 09:21:02 INFO - "pgo_build": "False", 09:21:02 INFO - "basedir": "C:\\slave\\test", 09:21:02 INFO - "buildnumber": 32, 09:21:02 INFO - "slavename": "t-w864-ix-175", 09:21:02 INFO - "revision": "baa84a5b4465238deaf0eb1ba28ec7fd38154ef6", 09:21:02 INFO - "master": "http://buildbot-master111.bb.releng.scl3.mozilla.com:8201/", 09:21:02 INFO - "platform": "win64", 09:21:02 INFO - "branch": "fx-team", 09:21:02 INFO - "repo_path": "integration/fx-team", 09:21:02 INFO - "moz_repo_path": "", 09:21:02 INFO - "stage_platform": "win64", 09:21:02 INFO - "builduid": "e66f5047306d4b99bf31a3312915996b", 09:21:02 INFO - "slavebuilddir": "test" 09:21:02 INFO - } 09:21:02 INFO - Found a test packages url https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.test_packages.json. 09:21:02 INFO - Found installer url https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.zip. 09:21:02 INFO - Running post-action listener: _resource_record_post_action 09:21:02 INFO - ##### 09:21:02 INFO - ##### Running download-and-extract step. 09:21:02 INFO - ##### 09:21:02 INFO - Running pre-action listener: _resource_record_pre_action 09:21:02 INFO - Running main action method: download_and_extract 09:21:02 INFO - mkdir: C:\slave\test\build\tests 09:21:02 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pvtbuilds.pvt.build.mozilla.org', 'pvtbuilds.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org'), ('https://queue.taskcluster.net', 'queue.taskcluster.net')]} 09:21:02 INFO - https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.test_packages.json matches https://queue.taskcluster.net 09:21:02 INFO - trying https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.test_packages.json 09:21:02 INFO - Downloading https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.test_packages.json to C:\slave\test\build\firefox-48.0a1.en-US.win64.test_packages.json 09:21:02 INFO - retry: Calling _download_file with args: (), kwargs: {'url': 'https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.test_packages.json', 'file_name': 'C:\\slave\\test\\build\\firefox-48.0a1.en-US.win64.test_packages.json'}, attempt #1 09:21:03 INFO - Downloaded 1274 bytes. 09:21:03 INFO - Reading from file C:\slave\test\build\firefox-48.0a1.en-US.win64.test_packages.json 09:21:03 INFO - Using the following test package requirements: 09:21:03 INFO - {u'common': [u'firefox-48.0a1.en-US.win64.common.tests.zip'], 09:21:03 INFO - u'cppunittest': [u'firefox-48.0a1.en-US.win64.common.tests.zip', 09:21:03 INFO - u'firefox-48.0a1.en-US.win64.cppunittest.tests.zip'], 09:21:03 INFO - u'gtest': [u'firefox-48.0a1.en-US.win64.common.tests.zip', 09:21:03 INFO - u'firefox-48.0a1.en-US.win64.gtest.tests.zip'], 09:21:03 INFO - u'jittest': [u'firefox-48.0a1.en-US.win64.common.tests.zip', 09:21:03 INFO - u'jsshell-win64.zip'], 09:21:03 INFO - u'mochitest': [u'firefox-48.0a1.en-US.win64.common.tests.zip', 09:21:03 INFO - u'firefox-48.0a1.en-US.win64.mochitest.tests.zip'], 09:21:03 INFO - u'mozbase': [u'firefox-48.0a1.en-US.win64.common.tests.zip'], 09:21:03 INFO - u'reftest': [u'firefox-48.0a1.en-US.win64.common.tests.zip', 09:21:03 INFO - u'firefox-48.0a1.en-US.win64.reftest.tests.zip'], 09:21:03 INFO - u'talos': [u'firefox-48.0a1.en-US.win64.common.tests.zip', 09:21:03 INFO - u'firefox-48.0a1.en-US.win64.talos.tests.zip'], 09:21:03 INFO - u'web-platform': [u'firefox-48.0a1.en-US.win64.common.tests.zip', 09:21:03 INFO - u'firefox-48.0a1.en-US.win64.web-platform.tests.zip'], 09:21:03 INFO - u'xpcshell': [u'firefox-48.0a1.en-US.win64.common.tests.zip', 09:21:03 INFO - u'firefox-48.0a1.en-US.win64.xpcshell.tests.zip']} 09:21:03 INFO - Downloading packages: [u'firefox-48.0a1.en-US.win64.common.tests.zip', u'firefox-48.0a1.en-US.win64.web-platform.tests.zip'] for test suite category: web-platform 09:21:03 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pvtbuilds.pvt.build.mozilla.org', 'pvtbuilds.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org'), ('https://queue.taskcluster.net', 'queue.taskcluster.net')]} 09:21:03 INFO - https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.common.tests.zip matches https://queue.taskcluster.net 09:21:03 INFO - trying https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.common.tests.zip 09:21:03 INFO - Downloading https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.common.tests.zip to C:\slave\test\build\firefox-48.0a1.en-US.win64.common.tests.zip 09:21:03 INFO - retry: Calling _download_file with args: (), kwargs: {'url': u'https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.common.tests.zip', 'file_name': u'C:\\slave\\test\\build\\firefox-48.0a1.en-US.win64.common.tests.zip'}, attempt #1 09:21:05 INFO - Downloaded 19070659 bytes. 09:21:05 INFO - Running command: ['unzip', '-q', '-o', u'C:\\slave\\test\\build\\firefox-48.0a1.en-US.win64.common.tests.zip', '-d', 'C:\\slave\\test\\build\\tests', 'bin/*', 'config/*', 'mozbase/*', 'marionette/*', 'tools/wptserve/*', 'web-platform/*'] 09:21:05 INFO - Copy/paste: unzip -q -o C:\slave\test\build\firefox-48.0a1.en-US.win64.common.tests.zip -d C:\slave\test\build\tests bin/* config/* mozbase/* marionette/* tools/wptserve/* web-platform/* 09:21:06 INFO - caution: filename not matched: web-platform/* 09:21:06 INFO - Return code: 11 09:21:06 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pvtbuilds.pvt.build.mozilla.org', 'pvtbuilds.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org'), ('https://queue.taskcluster.net', 'queue.taskcluster.net')]} 09:21:06 INFO - https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.web-platform.tests.zip matches https://queue.taskcluster.net 09:21:06 INFO - trying https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.web-platform.tests.zip 09:21:06 INFO - Downloading https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.web-platform.tests.zip to C:\slave\test\build\firefox-48.0a1.en-US.win64.web-platform.tests.zip 09:21:06 INFO - retry: Calling _download_file with args: (), kwargs: {'url': u'https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.web-platform.tests.zip', 'file_name': u'C:\\slave\\test\\build\\firefox-48.0a1.en-US.win64.web-platform.tests.zip'}, attempt #1 09:21:12 INFO - Downloaded 36397880 bytes. 09:21:12 INFO - Running command: ['unzip', '-q', '-o', u'C:\\slave\\test\\build\\firefox-48.0a1.en-US.win64.web-platform.tests.zip', '-d', 'C:\\slave\\test\\build\\tests', 'bin/*', 'config/*', 'mozbase/*', 'marionette/*', 'tools/wptserve/*', 'web-platform/*'] 09:21:12 INFO - Copy/paste: unzip -q -o C:\slave\test\build\firefox-48.0a1.en-US.win64.web-platform.tests.zip -d C:\slave\test\build\tests bin/* config/* mozbase/* marionette/* tools/wptserve/* web-platform/* 09:22:04 INFO - caution: filename not matched: bin/* 09:22:04 INFO - caution: filename not matched: config/* 09:22:04 INFO - caution: filename not matched: mozbase/* 09:22:04 INFO - caution: filename not matched: marionette/* 09:22:04 INFO - caution: filename not matched: tools/wptserve/* 09:22:04 INFO - Return code: 11 09:22:04 INFO - proxxy config: {'regions': ['.use1.', '.usw2.', '.scl3'], 'instances': ['proxxy1.srv.releng.use1.mozilla.com', 'proxxy1.srv.releng.usw2.mozilla.com', 'proxxy1.srv.releng.scl3.mozilla.com'], 'urls': [('http://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp.mozilla.org', 'ftp.mozilla.org'), ('https://ftp-ssl.mozilla.org', 'ftp.mozilla.org'), ('http://pvtbuilds.pvt.build.mozilla.org', 'pvtbuilds.mozilla.org'), ('http://pypi.pvt.build.mozilla.org', 'pypi.pvt.build.mozilla.org'), ('http://pypi.pub.build.mozilla.org', 'pypi.pub.build.mozilla.org'), ('https://queue.taskcluster.net', 'queue.taskcluster.net')]} 09:22:04 INFO - https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.zip matches https://queue.taskcluster.net 09:22:04 INFO - trying https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.zip 09:22:04 INFO - Downloading https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.zip to C:\slave\test\build\firefox-48.0a1.en-US.win64.zip 09:22:04 INFO - retry: Calling _download_file with args: (), kwargs: {'url': 'https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.zip', 'file_name': 'C:\\slave\\test\\build\\firefox-48.0a1.en-US.win64.zip'}, attempt #1 09:22:06 INFO - Downloaded 56633279 bytes. 09:22:06 INFO - Setting buildbot property build_url to https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.zip 09:22:06 INFO - mkdir: C:\slave\test\properties 09:22:06 INFO - Writing buildbot properties ['build_url'] to C:\slave\test\properties\build_url 09:22:06 INFO - Writing to file C:\slave\test\properties\build_url 09:22:06 INFO - Contents: 09:22:06 INFO - build_url:https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.zip 09:23:05 INFO - Running post-action listener: _resource_record_post_action 09:23:05 INFO - Running post-action listener: set_extra_try_arguments 09:23:06 FATAL - Uncaught exception: Traceback (most recent call last): 09:23:06 FATAL - File "C:\slave\test\scripts\mozharness\base\script.py", line 1765, in run 09:23:06 FATAL - self.run_action(action) 09:23:06 FATAL - File "C:\slave\test\scripts\mozharness\base\script.py", line 1707, in run_action 09:23:06 FATAL - self._possibly_run_method(method_name, error_if_missing=True) 09:23:06 FATAL - File "C:\slave\test\scripts\mozharness\base\script.py", line 1647, in _possibly_run_method 09:23:06 FATAL - return getattr(self, method_name)() 09:23:06 FATAL - File "scripts/scripts/web_platform_tests.py", line 175, in download_and_extract 09:23:06 FATAL - suite_categories=["web-platform"]) 09:23:06 FATAL - File "C:\slave\test\scripts\mozharness\mozilla\testing\testbase.py", line 566, in download_and_extract 09:23:06 FATAL - self._download_and_extract_symbols() 09:23:06 FATAL - File "C:\slave\test\scripts\mozharness\mozilla\testing\testbase.py", line 518, in _download_and_extract_symbols 09:23:06 FATAL - self.symbols_url = self.query_symbols_url() 09:23:06 FATAL - File "C:\slave\test\scripts\mozharness\mozilla\testing\testbase.py", line 199, in query_symbols_url 09:23:06 FATAL - self._urlopen(symbols_url) 09:23:06 FATAL - File "C:\slave\test\scripts\mozharness\mozilla\testing\testbase.py", line 292, in _urlopen 09:23:06 FATAL - return urllib2.urlopen(url, **kwargs) 09:23:06 FATAL - File "c:\mozilla-build\python27\lib\urllib2.py", line 126, in urlopen 09:23:06 FATAL - return _opener.open(url, data, timeout) 09:23:06 FATAL - File "c:\mozilla-build\python27\lib\urllib2.py", line 400, in open 09:23:06 FATAL - response = self._open(req, data) 09:23:06 FATAL - File "c:\mozilla-build\python27\lib\urllib2.py", line 418, in _open 09:23:06 FATAL - '_open', req) 09:23:06 FATAL - File "c:\mozilla-build\python27\lib\urllib2.py", line 378, in _call_chain 09:23:06 FATAL - result = func(*args) 09:23:06 FATAL - File "c:\mozilla-build\python27\lib\urllib2.py", line 1215, in https_open 09:23:06 FATAL - return self.do_open(httplib.HTTPSConnection, req) 09:23:06 FATAL - File "c:\mozilla-build\python27\lib\urllib2.py", line 1180, in do_open 09:23:06 FATAL - r = h.getresponse(buffering=True) 09:23:06 FATAL - File "c:\mozilla-build\python27\lib\httplib.py", line 1030, in getresponse 09:23:06 FATAL - response.begin() 09:23:06 FATAL - File "c:\mozilla-build\python27\lib\httplib.py", line 407, in begin 09:23:06 FATAL - version, status, reason = self._read_status() 09:23:06 FATAL - File "c:\mozilla-build\python27\lib\httplib.py", line 371, in _read_status 09:23:06 FATAL - raise BadStatusLine(line) 09:23:06 FATAL - BadStatusLine: '' 09:23:06 FATAL - Running post_fatal callback... 09:23:06 FATAL - Exiting -1 09:23:06 INFO - Running post-run listener: _resource_record_post_run 09:23:06 INFO - Running post-run listener: _upload_blobber_files 09:23:06 INFO - Blob upload gear active. 09:23:06 WARNING - Blob upload directory does not exist! 09:23:06 INFO - Running post-run listener: copy_logs_to_upload_dir 09:23:06 INFO - Copying logs to upload dir... 09:23:06 INFO - mkdir: C:\slave\test\build\upload\logs program finished with exit code -1 elapsedTime=195.372000 ========= master_lag: 0.48 ========= ========= Finished 'c:/mozilla-build/python27/python -u ...' failed (results: 2, elapsed: 3 mins, 15 secs) (at 2016-04-21 09:23:05.774292) ========= ========= Started set props: build_url (results: 0, elapsed: 0 secs) (at 2016-04-21 09:23:05.775064) ========= 'cmd' '/C' 'for' '%f' 'in' '(*)' 'do' '@type' '%f' in dir C:\slave\test\properties (timeout 1200 secs) watching logfiles {} argv: ['cmd', '/C', 'for', '%f', 'in', '(*)', 'do', '@type', '%f'] environment: ALLUSERSPROFILE=C:\ProgramData APPDATA=C:\Users\cltbld.T-W864-IX-175\AppData\Roaming COMMONPROGRAMFILES=C:\Program Files (x86)\Common Files COMMONPROGRAMFILES(X86)=C:\Program Files (x86)\Common Files COMMONPROGRAMW6432=C:\Program Files\Common Files COMPUTERNAME=T-W864-IX-175 COMSPEC=C:\windows\system32\cmd.exe DCLOCATION=SCL3 DNSSUFFIX=wintest.releng.scl3.mozilla.com FP_NO_HOST_CHECK=NO HOMEDRIVE=C: HOMEPATH=\Users\cltbld.T-W864-IX-175 KTS_HOME=C:\Program Files\KTS KTS_VERSION=1.19c LOCALAPPDATA=C:\Users\cltbld.T-W864-IX-175\AppData\Local LOGONSERVER=\\T-W864-IX-175 MONDIR=C:\Monitor_config\ MOZBUILDDIR=C:\mozilla-build\ NUMBER_OF_PROCESSORS=8 OS=Windows_NT OURDRIVE=C: PATH=C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\mozilla-build\python27;C:\mozilla-build\python27\Scripts;C:\mozilla-build\msys\bin;C:\mozilla-build\vim\vim72;C:\mozilla-build\wget;C:\mozilla-build\info-zip;C:\CoreUtils\bin;C:\mozilla-build\buildbotve\scripts PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PROCESSOR_ARCHITECTURE=x86 PROCESSOR_ARCHITEW6432=AMD64 PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel PROCESSOR_LEVEL=6 PROCESSOR_REVISION=1e05 PROGRAMDATA=C:\ProgramData PROGRAMFILES=C:\Program Files (x86) PROGRAMFILES(X86)=C:\Program Files (x86) PROGRAMW6432=C:\Program Files PROMPT=$P$G PSMODULEPATH=C:\windows\system32\WindowsPowerShell\v1.0\Modules\ PUBLIC=C:\Users\Public PWD=C:\slave\test\properties RUNLOGFILE=C:\slave\\runslave.log SLAVEDIR=C:\slave\ SYSTEMDRIVE=C: SYSTEMROOT=C:\windows TEMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp TEST1=testie TMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp USERDOMAIN=T-W864-IX-175 USERDOMAIN_ROAMINGPROFILE=T-W864-IX-175 USERNAME=cltbld USERPROFILE=C:\Users\cltbld.T-W864-IX-175 WINDIR=C:\windows using PTY: False build_url:https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.zip program finished with exit code 0 elapsedTime=0.101000 build_url: 'https://queue.taskcluster.net/v1/task/aH7SMfhsTCqzSPd2CEDW9A/artifacts/public/build/firefox-48.0a1.en-US.win64.zip' ========= master_lag: 0.02 ========= ========= Finished set props: build_url (results: 0, elapsed: 0 secs) (at 2016-04-21 09:23:05.892481) ========= ========= Started 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2016-04-21 09:23:05.892880) ========= 'rm' '-f' 'oauth.txt' in dir C:\slave\test\. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'oauth.txt'] environment: ALLUSERSPROFILE=C:\ProgramData APPDATA=C:\Users\cltbld.T-W864-IX-175\AppData\Roaming COMMONPROGRAMFILES=C:\Program Files (x86)\Common Files COMMONPROGRAMFILES(X86)=C:\Program Files (x86)\Common Files COMMONPROGRAMW6432=C:\Program Files\Common Files COMPUTERNAME=T-W864-IX-175 COMSPEC=C:\windows\system32\cmd.exe DCLOCATION=SCL3 DNSSUFFIX=wintest.releng.scl3.mozilla.com FP_NO_HOST_CHECK=NO HOMEDRIVE=C: HOMEPATH=\Users\cltbld.T-W864-IX-175 KTS_HOME=C:\Program Files\KTS KTS_VERSION=1.19c LOCALAPPDATA=C:\Users\cltbld.T-W864-IX-175\AppData\Local LOGONSERVER=\\T-W864-IX-175 MONDIR=C:\Monitor_config\ MOZBUILDDIR=C:\mozilla-build\ NUMBER_OF_PROCESSORS=8 OS=Windows_NT OURDRIVE=C: PATH=C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\windows\system32;C:\windows;C:\windows\System32\Wbem;C:\windows\System32\WindowsPowerShell\v1.0\;C:\mozilla-build\python27;C:\mozilla-build\python27\Scripts;C:\mozilla-build\msys\bin;C:\mozilla-build\vim\vim72;C:\mozilla-build\wget;C:\mozilla-build\info-zip;C:\CoreUtils\bin;C:\mozilla-build\buildbotve\scripts PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PROCESSOR_ARCHITECTURE=x86 PROCESSOR_ARCHITEW6432=AMD64 PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 30 Stepping 5, GenuineIntel PROCESSOR_LEVEL=6 PROCESSOR_REVISION=1e05 PROGRAMDATA=C:\ProgramData PROGRAMFILES=C:\Program Files (x86) PROGRAMFILES(X86)=C:\Program Files (x86) PROGRAMW6432=C:\Program Files PROMPT=$P$G PSMODULEPATH=C:\windows\system32\WindowsPowerShell\v1.0\Modules\ PUBLIC=C:\Users\Public PWD=C:\slave\test RUNLOGFILE=C:\slave\\runslave.log SLAVEDIR=C:\slave\ SYSTEMDRIVE=C: SYSTEMROOT=C:\windows TEMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp TEST1=testie TMP=C:\Users\CLTBLD~1.T-W\AppData\Local\Temp USERDOMAIN=T-W864-IX-175 USERDOMAIN_ROAMINGPROFILE=T-W864-IX-175 USERNAME=cltbld USERPROFILE=C:\Users\cltbld.T-W864-IX-175 WINDIR=C:\windows using PTY: False program finished with exit code 0 elapsedTime=0.101000 ========= master_lag: 0.02 ========= ========= Finished 'rm -f ...' (results: 0, elapsed: 0 secs) (at 2016-04-21 09:23:06.009096) ========= ========= Started reboot slave lost (results: 0, elapsed: 0 secs) (at 2016-04-21 09:23:06.009416) ========= ========= Finished reboot slave lost (results: 0, elapsed: 0 secs) (at 2016-04-21 09:23:06.788440) ========= ========= Total master_lag: 5.09 =========