builder: release-mozilla-beta-firefox_chcksms slave: bld-linux64-spot-016 starttime: 1486114184.82 results: success (0) revision: d171c36d484800b1bb00db1612460a7120dd2fdf ========= Started set props: master (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:44.822081) ========= master: http://buildbot-master71.bb.releng.use1.mozilla.com:8001/ ========= Finished set props: master (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:44.822512) ========= ========= Started downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:44.822792) ========= ========= Finished downloading to buildprops.json (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:44.981666) ========= ========= Started 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:44.981949) ========= rm -rf scripts properties in dir /builds/slave/rel-m-beta-fx_chcksms-00000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-rf', 'scripts', 'properties'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-016.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fx_chcksms-00000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.003000 ========= master_lag: 0.05 ========= ========= Finished 'rm -rf ...' (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:45.030753) ========= ========= Started 'bash -c ...' (results: 0, elapsed: 2 secs) (at 2017-02-03 01:29:45.031089) ========= bash -c 'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo releases/mozilla-beta --rev d171c36d484800b1bb00db1612460a7120dd2fdf --destination scripts --debug' in dir /builds/slave/rel-m-beta-fx_chcksms-00000000/. (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', u'python /tools/checkouts/build-tools/buildfarm/utils/archiver_client.py mozharness --repo releases/mozilla-beta --rev d171c36d484800b1bb00db1612460a7120dd2fdf --destination scripts --debug'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-016.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fx_chcksms-00000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False 2017-02-03 01:29:45,075 truncating revision to first 12 chars 2017-02-03 01:29:45,075 Setting DEBUG logging. 2017-02-03 01:29:45,075 attempt 1/10 2017-02-03 01:29:45,075 Getting archive location from https://api.pub.build.mozilla.org/archiver/hgmo/releases/mozilla-beta/d171c36d4848?&preferred_region=us-west-2&suffix=tar.gz&subdir=testing/mozharness 2017-02-03 01:29:46,905 unpacking tar archive at: mozilla-beta-d171c36d4848/testing/mozharness/ program finished with exit code 0 elapsedTime=2.420535 ========= master_lag: 0.01 ========= ========= Finished 'bash -c ...' (results: 0, elapsed: 2 secs) (at 2017-02-03 01:29:47.461102) ========= ========= Started set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:47.461425) ========= script_repo_revision: d171c36d484800b1bb00db1612460a7120dd2fdf ========= Finished set props: script_repo_revision (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:47.461785) ========= ========= Started remove old nonce (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:47.462275) ========= rm -f nonce in dir /builds/slave/rel-m-beta-fx_chcksms-00000000/. (timeout 1200 secs) watching logfiles {} argv: ['rm', '-f', 'nonce'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-016.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fx_chcksms-00000000 SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.002837 ========= master_lag: 0.04 ========= ========= Finished remove old nonce (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:47.509686) ========= ========= Started downloading to token (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:47.509954) ========= Slave: bld-linux64-spot-016 IP: 10.134.55.93 Duration: 25200 URI: https://mac-v2-signing1.srv.releng.scl3.mozilla.com:9120/token ========= Finished downloading to token (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:48.018021) ========= ========= Started set props: toolsdir (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:48.018452) ========= bash -c pwd in dir /tools/checkouts/build-tools (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'pwd'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-016.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/tools/checkouts/build-tools SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False /tools/checkouts/build-tools program finished with exit code 0 elapsedTime=0.003075 toolsdir: '/tools/checkouts/build-tools' ========= master_lag: 0.04 ========= ========= Finished set props: toolsdir (results: 0, elapsed: 0 secs) (at 2017-02-03 01:29:48.065609) ========= ========= Started '/tools/buildbot/bin/python scripts/scripts/release/generate-checksums.py ...' (results: 0, elapsed: 1 mins, 59 secs) (at 2017-02-03 01:29:48.065903) ========= /tools/buildbot/bin/python scripts/scripts/release/generate-checksums.py --stage-product firefox --bucket-name-full net-mozaws-prod-delivery-firefox --credentials /builds/release-s3.credentials --tools-repo /tools/checkouts/build-tools in dir /builds/slave/rel-m-beta-fx_chcksms-00000000/. (timeout 3600 secs) (maxTime 14400 secs) watching logfiles {} argv: ['/tools/buildbot/bin/python', 'scripts/scripts/release/generate-checksums.py', '--stage-product', 'firefox', '--bucket-name-full', 'net-mozaws-prod-delivery-firefox', '--credentials', '/builds/release-s3.credentials', '--tools-repo', '/tools/checkouts/build-tools'] environment: CCACHE_COMPRESS=1 CCACHE_DIR=/builds/ccache CCACHE_HASHDIR= CCACHE_UMASK=002 DISPLAY=:2 G_BROKEN_FILENAMES=1 HG_SHARE_BASE_DIR=/builds/hg-shared HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-016.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LC_ALL=C LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld MOZ_AUTOMATION=1 MOZ_CRASHREPORTER_NO_REPORT=1 MOZ_OBJDIR=obj-firefox MOZ_SIGNING_SERVERS=gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120 MOZ_SIGN_CMD=python /tools/checkouts/build-tools/release/signing/signtool.py --cachedir /builds/slave/rel-m-beta-fx_chcksms-00000000/signing_cache -t /builds/slave/rel-m-beta-fx_chcksms-00000000/token -n /builds/slave/rel-m-beta-fx_chcksms-00000000/nonce -c /tools/checkouts/build-tools/release/signing/host.cert -H gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120 PATH=/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin PROPERTIES_FILE=/builds/slave/rel-m-beta-fx_chcksms-00000000/buildprops.json PWD=/builds/slave/rel-m-beta-fx_chcksms-00000000 SHELL=/bin/bash SHLVL=1 TERM=linux TINDERBOX_OUTPUT=1 TMOUT=86400 TOOLTOOL_CACHE=/builds/tooltool_cache TOOLTOOL_HOME=/builds USER=cltbld _=/tools/buildbot/bin/python using PTY: False 01:29:48 INFO - MultiFileLogger online at 20170203 01:29:48 in /builds/slave/rel-m-beta-fx_chcksms-00000000 01:29:48 INFO - Using buildbot properties: 01:29:48 INFO - { 01:29:48 INFO - "project": "", 01:29:48 INFO - "product": "firefox", 01:29:48 INFO - "build_number": 1, 01:29:48 INFO - "taskId": "NHXN9YtSQ560SfPDHl6deg", 01:29:48 INFO - "repository": "", 01:29:48 INFO - "buildername": "release-mozilla-beta-firefox_chcksms", 01:29:48 INFO - "basedir": "/builds/slave/rel-m-beta-fx_chcksms-00000000", 01:29:48 INFO - "buildnumber": 7, 01:29:48 INFO - "platform": null, 01:29:48 INFO - "version": "52.0b3", 01:29:48 INFO - "release_promotion": true, 01:29:48 INFO - "script_repo_revision": "d171c36d484800b1bb00db1612460a7120dd2fdf", 01:29:48 INFO - "branch": "mozilla-beta", 01:29:48 INFO - "master": "http://buildbot-master71.bb.releng.use1.mozilla.com:8001/", 01:29:48 INFO - "revision": "d171c36d484800b1bb00db1612460a7120dd2fdf", 01:29:48 INFO - "slavename": "bld-linux64-spot-016", 01:29:48 INFO - "repo_path": "releases/mozilla-beta" 01:29:48 INFO - } 01:29:48 INFO - Overriding version with 52.0b3 01:29:48 INFO - Overriding build_number with 1 01:29:48 INFO - Run as scripts/scripts/release/generate-checksums.py --stage-product firefox --bucket-name-full net-mozaws-prod-delivery-firefox --credentials /builds/release-s3.credentials --tools-repo /tools/checkouts/build-tools 01:29:48 INFO - Dumping config to /builds/slave/rel-m-beta-fx_chcksms-00000000/logs/localconfig.json. 01:29:48 INFO - {'append_to_log': False, 01:29:48 INFO - 'base_work_dir': '/builds/slave/rel-m-beta-fx_chcksms-00000000', 01:29:48 INFO - 'bucket_name_full': 'net-mozaws-prod-delivery-firefox', 01:29:48 INFO - 'build_number': 1, 01:29:48 INFO - 'buildbot_json_path': 'buildprops.json', 01:29:48 INFO - 'credentials': '/builds/release-s3.credentials', 01:29:48 INFO - 'formats': ('sha512',), 01:29:48 INFO - 'includes': ('^.*\\.tar\\.bz2$', 01:29:48 INFO - '^.*\\.tar\\.xz$', 01:29:48 INFO - '^.*\\.dmg$', 01:29:48 INFO - '^.*\\.bundle$', 01:29:48 INFO - '^.*\\.mar$', 01:29:48 INFO - '^.*Setup.*\\.exe$', 01:29:48 INFO - '^.*\\.xpi$', 01:29:48 INFO - '^.*fennec.*\\.apk$'), 01:29:48 INFO - 'log_level': 'info', 01:29:48 INFO - 'log_to_console': True, 01:29:48 INFO - 'opt_config_files': (), 01:29:48 INFO - 'parallelization': 20, 01:29:48 INFO - 'pip_index': True, 01:29:48 INFO - 'stage_product': 'firefox', 01:29:48 INFO - 'tools_repo': '/tools/checkouts/build-tools', 01:29:48 INFO - 'version': u'52.0b3', 01:29:48 INFO - 'virtualenv_modules': ('boto',), 01:29:48 INFO - 'virtualenv_path': 'venv', 01:29:48 INFO - 'volatile_config': {'actions': None, 'add_actions': None, 'no_actions': None}, 01:29:48 INFO - 'work_dir': 'build'} 01:29:48 INFO - [mozharness: 2017-02-03 09:29:48.231410Z] Running create-virtualenv step. 01:29:48 INFO - Running main action method: create_virtualenv 01:29:48 INFO - Creating virtualenv /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv 01:29:48 INFO - mkdir: /builds/slave/rel-m-beta-fx_chcksms-00000000/build 01:29:48 INFO - Running command: ['virtualenv', '--no-site-packages', '--distribute', '/builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv'] in /builds/slave/rel-m-beta-fx_chcksms-00000000/build 01:29:48 INFO - Copy/paste: virtualenv --no-site-packages --distribute /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv 01:29:48 INFO - The --no-site-packages flag is deprecated; it is now the default behavior. 01:29:48 INFO - New python executable in /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/python2.7 01:29:48 INFO - Also creating executable in /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/python 01:29:48 INFO - Installing distribute.............................................................................................................................................................................................done. 01:29:49 INFO - Installing pip...............done. 01:29:49 INFO - Return code: 0 01:29:49 INFO - Getting output from command: ['/builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pip', '--version'] 01:29:49 INFO - Copy/paste: /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pip --version 01:29:49 INFO - Reading from file tmpfile_stdout 01:29:49 INFO - Output received: 01:29:49 INFO - pip 1.1 from /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/lib/python2.7/site-packages/pip-1.1-py2.7.egg (python 2.7) 01:29:49 INFO - Installing boto into virtualenv /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv 01:29:49 INFO - retry: Calling run_command with args: [['/builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pip', 'install', '--timeout', '120', 'boto']], kwargs: {'error_level': 'warning', 'error_list': [{'substr': 'not found or a compiler error:', 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x1d81170>, 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x1af42d0>, 'level': 'warning'}, {'regex': <_sre.SRE_Pattern object at 0x1f72a40>, 'level': 'debug'}, {'substr': 'command not found', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x1d63030>, 'level': 'warning'}, {'substr': 'Traceback (most recent call last)', 'level': 'error'}, {'substr': 'SyntaxError: ', 'level': 'error'}, {'substr': 'TypeError: ', 'level': 'error'}, {'substr': 'NameError: ', 'level': 'error'}, {'substr': 'ZeroDivisionError: ', 'level': 'error'}, {'regex': <_sre.SRE_Pattern object at 0x1eb1cd8>, 'level': 'critical'}, {'regex': <_sre.SRE_Pattern object at 0x1e02d78>, 'level': 'critical'}], 'cwd': '/builds/slave/rel-m-beta-fx_chcksms-00000000/build', 'env': {'MOZ_AUTOMATION': '1', 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 'TMOUT': '86400', 'LOGNAME': 'cltbld', 'USER': 'cltbld', 'MOZ_OBJDIR': 'obj-firefox', 'BOTO_CONFIG': '/builds/release-s3.credentials', 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 'DISPLAY': ':2', 'CCACHE_UMASK': '002', 'LANG': 'en_US.UTF-8', 'CCACHE_HASHDIR': '', 'TERM': 'linux', 'SHELL': '/bin/bash', 'MOZ_SIGNING_SERVERS': 'gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 'SHLVL': '1', 'G_BROKEN_FILENAMES': '1', 'HISTSIZE': '1000', 'HOME': '/home/cltbld', 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 'MOZ_CRASHREPORTER_NO_REPORT': '1', 'TINDERBOX_OUTPUT': '1', 'MOZ_SIGN_CMD': 'python /tools/checkouts/build-tools/release/signing/signtool.py --cachedir /builds/slave/rel-m-beta-fx_chcksms-00000000/signing_cache -t /builds/slave/rel-m-beta-fx_chcksms-00000000/token -n /builds/slave/rel-m-beta-fx_chcksms-00000000/nonce -c /tools/checkouts/build-tools/release/signing/host.cert -H gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 'LC_ALL': 'C', 'TOOLTOOL_HOME': '/builds', '_': '/tools/buildbot/bin/python', 'MAIL': '/var/spool/mail/cltbld', 'HOSTNAME': 'bld-linux64-spot-016.build.releng.use1.mozilla.com', 'HISTCONTROL': 'ignoredups', 'PWD': '/builds/slave/rel-m-beta-fx_chcksms-00000000', 'PROPERTIES_FILE': '/builds/slave/rel-m-beta-fx_chcksms-00000000/buildprops.json', 'CCACHE_DIR': '/builds/ccache', 'CCACHE_COMPRESS': '1', 'TOOLTOOL_CACHE': '/builds/tooltool_cache'}}, attempt #1 01:29:49 INFO - Running command: ['/builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pip', 'install', '--timeout', '120', 'boto'] in /builds/slave/rel-m-beta-fx_chcksms-00000000/build 01:29:49 INFO - Copy/paste: /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pip install --timeout 120 boto 01:29:49 INFO - Using env: {'BOTO_CONFIG': '/builds/release-s3.credentials', 01:29:49 INFO - 'CCACHE_COMPRESS': '1', 01:29:49 INFO - 'CCACHE_DIR': '/builds/ccache', 01:29:49 INFO - 'CCACHE_HASHDIR': '', 01:29:49 INFO - 'CCACHE_UMASK': '002', 01:29:49 INFO - 'DISPLAY': ':2', 01:29:49 INFO - 'G_BROKEN_FILENAMES': '1', 01:29:49 INFO - 'HG_SHARE_BASE_DIR': '/builds/hg-shared', 01:29:49 INFO - 'HISTCONTROL': 'ignoredups', 01:29:49 INFO - 'HISTSIZE': '1000', 01:29:49 INFO - 'HOME': '/home/cltbld', 01:29:49 INFO - 'HOSTNAME': 'bld-linux64-spot-016.build.releng.use1.mozilla.com', 01:29:49 INFO - 'LANG': 'en_US.UTF-8', 01:29:49 INFO - 'LC_ALL': 'C', 01:29:49 INFO - 'LESSOPEN': '|/usr/bin/lesspipe.sh %s', 01:29:49 INFO - 'LOGNAME': 'cltbld', 01:29:49 INFO - 'MAIL': '/var/spool/mail/cltbld', 01:29:49 INFO - 'MOZ_AUTOMATION': '1', 01:29:49 INFO - 'MOZ_CRASHREPORTER_NO_REPORT': '1', 01:29:49 INFO - 'MOZ_OBJDIR': 'obj-firefox', 01:29:49 INFO - 'MOZ_SIGNING_SERVERS': 'gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120,gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120,dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 01:29:49 INFO - 'MOZ_SIGN_CMD': 'python /tools/checkouts/build-tools/release/signing/signtool.py --cachedir /builds/slave/rel-m-beta-fx_chcksms-00000000/signing_cache -t /builds/slave/rel-m-beta-fx_chcksms-00000000/token -n /builds/slave/rel-m-beta-fx_chcksms-00000000/nonce -c /tools/checkouts/build-tools/release/signing/host.cert -H gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 01:29:49 INFO - 'PATH': '/tools/buildbot/bin:/usr/local/bin:/usr/lib64/ccache:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/tools/git/bin:/tools/python27/bin:/tools/python27-mercurial/bin:/home/cltbld/bin', 01:29:49 INFO - 'PROPERTIES_FILE': '/builds/slave/rel-m-beta-fx_chcksms-00000000/buildprops.json', 01:29:49 INFO - 'PWD': '/builds/slave/rel-m-beta-fx_chcksms-00000000', 01:29:49 INFO - 'SHELL': '/bin/bash', 01:29:49 INFO - 'SHLVL': '1', 01:29:49 INFO - 'TERM': 'linux', 01:29:49 INFO - 'TINDERBOX_OUTPUT': '1', 01:29:49 INFO - 'TMOUT': '86400', 01:29:49 INFO - 'TOOLTOOL_CACHE': '/builds/tooltool_cache', 01:29:49 INFO - 'TOOLTOOL_HOME': '/builds', 01:29:49 INFO - 'USER': 'cltbld', 01:29:49 INFO - '_': '/tools/buildbot/bin/python'} 01:29:52 INFO - Ignoring indexes: http://pypi.python.org/simple/ 01:29:52 INFO - Downloading/unpacking boto 01:29:52 INFO - Running setup.py egg_info for package boto 01:29:52 INFO - warning: no files found matching 'boto/mturk/test/*.doctest' 01:29:52 INFO - warning: no files found matching 'boto/mturk/test/.gitignore' 01:29:52 INFO - Installing collected packages: boto 01:29:52 INFO - Running setup.py install for boto 01:29:52 INFO - warning: no files found matching 'boto/mturk/test/*.doctest' 01:29:52 INFO - warning: no files found matching 'boto/mturk/test/.gitignore' 01:29:52 INFO - changing mode of build/scripts-2.7/sdbadmin from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/elbadmin from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/cfadmin from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/s3put from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/fetch_file from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/launch_instance from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/list_instances from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/taskadmin from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/kill_instance from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/bundle_image from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/pyami_sendmail from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/lss3 from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/cq from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/route53 from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/cwutil from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/instance_events from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/asadmin from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/glacier from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/mturk from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/dynamodb_dump from 664 to 775 01:29:52 INFO - changing mode of build/scripts-2.7/dynamodb_load from 664 to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/cfadmin to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/sdbadmin to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/launch_instance to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/route53 to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/list_instances to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/dynamodb_load to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/cq to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/cwutil to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/s3put to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/dynamodb_dump to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/kill_instance to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/bundle_image to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/fetch_file to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/mturk to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/asadmin to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pyami_sendmail to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/lss3 to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/glacier to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/taskadmin to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/elbadmin to 775 01:29:52 INFO - changing mode of /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/instance_events to 775 01:29:52 INFO - Successfully installed boto 01:29:52 INFO - Cleaning up... 01:29:52 INFO - Return code: 0 01:29:52 INFO - Done creating virtualenv /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv. 01:29:52 INFO - Getting output from command: ['/builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pip', 'freeze'] 01:29:52 INFO - Copy/paste: /builds/slave/rel-m-beta-fx_chcksms-00000000/build/venv/bin/pip freeze 01:29:52 INFO - Reading from file tmpfile_stdout 01:29:52 INFO - Current package versions: 01:29:52 INFO - boto == 2.38.0 01:29:52 INFO - distribute == 0.6.24 01:29:52 INFO - wsgiref == 0.1.2 01:29:52 INFO - [mozharness: 2017-02-03 09:29:52.897216Z] Finished create-virtualenv step (success) 01:29:52 INFO - [mozharness: 2017-02-03 09:29:52.897416Z] Running collect-individual-checksums step. 01:29:52 INFO - Running main action method: collect_individual_checksums 01:29:52 INFO - Connecting to S3 01:29:52 INFO - Connecting to bucket net-mozaws-prod-delivery-firefox 01:29:53 INFO - File prefix is: pub/firefox/candidates/52.0b3-candidates/build1/ 01:29:53 INFO - Getting key names from bucket 01:29:56 INFO - Using beet format 01:31:38 INFO - [mozharness: 2017-02-03 09:31:38.129471Z] Finished collect-individual-checksums step (success) 01:31:38 INFO - [mozharness: 2017-02-03 09:31:38.129718Z] Running create-big-checksums step. 01:31:38 INFO - Running main action method: create_big_checksums 01:31:38 INFO - Creating big checksums file: SHA512SUMS 01:31:38 INFO - [mozharness: 2017-02-03 09:31:38.136476Z] Finished create-big-checksums step (success) 01:31:38 INFO - [mozharness: 2017-02-03 09:31:38.136706Z] Running sign step. 01:31:38 INFO - Running main action method: sign 01:31:38 INFO - retry: Calling _get_revision with args: (, '/builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools'), kwargs: {}, attempt #1 01:31:38 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', '--version'] 01:31:38 INFO - Copy/paste: hg --config ui.merge=internal:merge --version 01:31:38 INFO - Mercurial Distributed SCM (version 3.9.1) 01:31:38 INFO - (see https://mercurial-scm.org for more information) 01:31:38 INFO - Copyright (C) 2005-2016 Matt Mackall and others 01:31:38 INFO - This is free software; see the source for copying conditions. There is NO 01:31:38 INFO - warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. 01:31:38 INFO - Return code: 0 01:31:38 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', 'debuginstall'] 01:31:38 INFO - Copy/paste: hg --config ui.merge=internal:merge debuginstall 01:31:38 INFO - checking encoding (ascii)... 01:31:38 INFO - checking Python executable (/tools/python27/bin/python2.7) 01:31:38 INFO - checking Python version (2.7.3) 01:31:38 INFO - checking Python lib (/tools/python27/lib/python2.7)... 01:31:38 INFO - checking Mercurial version (3.9.1) 01:31:38 INFO - checking Mercurial custom build () 01:31:38 INFO - checking module policy (c) 01:31:38 INFO - checking installed modules (/tools/python27-mercurial/lib/python2.7/site-packages/mercurial)... 01:31:38 INFO - checking templates (/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/templates)... 01:31:38 INFO - checking default template (/tools/python27-mercurial/lib/python2.7/site-packages/mercurial/templates/map-cmdline.default) 01:31:38 INFO - checking commit editor... (vi) 01:31:38 INFO - checking username (Mozilla Release Engineering ) 01:31:38 INFO - no problems detected 01:31:38 INFO - Return code: 0 01:31:38 INFO - Running command: ['hg', '--config', 'ui.merge=internal:merge', '--config', 'extensions.robustcheckout=/builds/slave/rel-m-beta-fx_chcksms-00000000/scripts/external_tools/robustcheckout.py', 'robustcheckout', '/tools/checkouts/build-tools', '/builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools', '--sharebase', '/builds/hg-shared', '--branch', 'default'] 01:31:38 INFO - Copy/paste: hg --config ui.merge=internal:merge --config extensions.robustcheckout=/builds/slave/rel-m-beta-fx_chcksms-00000000/scripts/external_tools/robustcheckout.py robustcheckout /tools/checkouts/build-tools /builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools --sharebase /builds/hg-shared --branch default 01:31:39 INFO - ensuring /tools/checkouts/build-tools@default is available at /builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools 01:31:39 INFO - (sharing from existing pooled repository 7ae7fb134bf7aec6ec96a062ff47a69053dd2973) 01:31:39 INFO - searching for changes 01:31:39 INFO - no changes found 01:31:39 INFO - (pulling to obtain default) 01:31:39 INFO - (remote resolved default to 90b8c0e7fb57f7e56a743c4075d8f5c5d33aabbd; result is not deterministic) 01:31:39 INFO - (revision already present locally; not pulling) 01:31:39 INFO - 936 files updated, 0 files merged, 0 files removed, 0 files unresolved 01:31:39 INFO - updated to 90b8c0e7fb57f7e56a743c4075d8f5c5d33aabbd 01:31:39 INFO - Return code: 0 01:31:39 INFO - Signing big checksums file: SHA512SUMS 01:31:39 INFO - Running command: ['python', '/builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools/release/signing/signtool.py', '--cachedir', '/builds/slave/rel-m-beta-fx_chcksms-00000000/build/signing_cache', '-t', '/builds/slave/rel-m-beta-fx_chcksms-00000000/token', '-n', '/builds/slave/rel-m-beta-fx_chcksms-00000000/nonce', '-c', '/builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools/release/signing/host.cert', '-f', 'gpg', '-H', 'gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120', '-H', 'gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120', '-H', 'gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120', '-H', 'dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120', '-H', 'dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120', '-H', 'dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120', '-H', 'dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120', '-H', 'dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120', '-H', 'dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120', 'SHA512SUMS'] 01:31:39 INFO - Copy/paste: python /builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools/release/signing/signtool.py --cachedir /builds/slave/rel-m-beta-fx_chcksms-00000000/build/signing_cache -t /builds/slave/rel-m-beta-fx_chcksms-00000000/token -n /builds/slave/rel-m-beta-fx_chcksms-00000000/nonce -c /builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools/release/signing/host.cert -f gpg -H gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing4.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing5.srv.releng.scl3.mozilla.com:9120 -H gpg:sha2signcode:sha2signcodestub:osslsigncode:signcode:mar:mar_sha384:jar:emevoucher:signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing1.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing2.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing3.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing4.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing6.srv.releng.scl3.mozilla.com:9120 -H dmgv2:mac-v2-signing7.srv.releng.scl3.mozilla.com:9120 SHA512SUMS 01:31:39 INFO - 2017-02-03 01:31:39,726 - 553d0fc8870f3ddf3b0899c4ac3785a253303a79: processing SHA512SUMS on https://signing6.srv.releng.scl3.mozilla.com:9120 01:31:40 INFO - 2017-02-03 01:31:40,136 - 553d0fc8870f3ddf3b0899c4ac3785a253303a79: uploading for signing 01:31:42 INFO - 2017-02-03 01:31:42,313 - 553d0fc8870f3ddf3b0899c4ac3785a253303a79: processing SHA512SUMS on https://signing6.srv.releng.scl3.mozilla.com:9120 01:31:42 INFO - 2017-02-03 01:31:42,713 - 553d0fc8870f3ddf3b0899c4ac3785a253303a79: OK 01:31:42 INFO - 2017-02-03 01:31:42,714 - Copying SHA512SUMS.asc to cache /builds/slave/rel-m-beta-fx_chcksms-00000000/build/signing_cache/gpg/553d0fc8870f3ddf3b0899c4ac3785a253303a79 01:31:42 INFO - Return code: 0 01:31:42 INFO - [mozharness: 2017-02-03 09:31:42.720685Z] Finished sign step (success) 01:31:42 INFO - [mozharness: 2017-02-03 09:31:42.720874Z] Running upload step. 01:31:42 INFO - Running main action method: upload 01:31:42 INFO - Copying /builds/slave/rel-m-beta-fx_chcksms-00000000/build/tools/scripts/release/KEY to KEY 01:31:42 INFO - Uploading KEY to pub/firefox/candidates/52.0b3-candidates/build1/KEY 01:31:43 INFO - Uploading SHA512SUMS to pub/firefox/candidates/52.0b3-candidates/build1/SHA512SUMS 01:31:46 INFO - Uploading SHA512SUMS.asc to pub/firefox/candidates/52.0b3-candidates/build1/SHA512SUMS.asc 01:31:48 INFO - [mozharness: 2017-02-03 09:31:48.008953Z] Finished upload step (success) 01:31:48 INFO - [mozharness: 2017-02-03 09:31:48.009156Z] Skipping copy-info-files step. 01:31:48 INFO - Running post-run listener: copy_logs_to_upload_dir 01:31:48 INFO - Copying logs to upload dir... 01:31:48 INFO - mkdir: /builds/slave/rel-m-beta-fx_chcksms-00000000/build/upload/logs 01:31:48 INFO - Copying logs to upload dir... program finished with exit code 0 elapsedTime=119.967609 ========= master_lag: 0.01 ========= ========= Finished '/tools/buildbot/bin/python scripts/scripts/release/generate-checksums.py ...' (results: 0, elapsed: 1 mins, 59 secs) (at 2017-02-03 01:31:48.045091) ========= ========= Started no change (results: 0, elapsed: 0 secs) (at 2017-02-03 01:31:48.046678) ========= bash -c 'for file in `ls -1`; do cat $file; done' in dir /builds/slave/rel-m-beta-fx_chcksms-00000000/properties (timeout 1200 secs) watching logfiles {} argv: ['bash', '-c', 'for file in `ls -1`; do cat $file; done'] environment: CCACHE_HASHDIR= G_BROKEN_FILENAMES=1 HISTCONTROL=ignoredups HISTSIZE=1000 HOME=/home/cltbld HOSTNAME=bld-linux64-spot-016.build.releng.use1.mozilla.com LANG=en_US.UTF-8 LESSOPEN=|/usr/bin/lesspipe.sh %s LOGNAME=cltbld MAIL=/var/spool/mail/cltbld PATH=/usr/local/bin:/usr/lib64/ccache:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/cltbld/bin PWD=/builds/slave/rel-m-beta-fx_chcksms-00000000/properties SHELL=/bin/bash SHLVL=1 TERM=linux TMOUT=86400 USER=cltbld _=/tools/buildbot/bin/python using PTY: False program finished with exit code 0 elapsedTime=0.004990 ========= master_lag: 0.04 ========= ========= Finished no change (results: 0, elapsed: 0 secs) (at 2017-02-03 01:31:48.095365) ========= ========= Started reboot skipped (results: 3, elapsed: 0 secs) (at 2017-02-03 01:31:48.095675) ========= ========= Finished reboot skipped (results: 3, elapsed: 0 secs) (at 2017-02-03 01:31:48.095920) ========= ========= Total master_lag: 0.20 =========