Updated 2016-07-27 21:09:28 by oehhar

Test Suite Log edit

HaO I want to document test suite failures when running the test suite here. Others are invited to contribute.

The purpose of the page is to find any test suite differences when new versions are tested.

Tcl 8.4 and 8.5 edit

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc, build option: threads

Test8.4.208.5.148.5.158.5.168.5.178.5.18
filename-16.12fail(2)
filename-16.13fail(2)
filename-16.14fail
filename-16.15fail
filesystem-1.3failfailfailfailfail
filesystem-1.4failfailfailfailfail
filesystem-1.39fail
filesystem-20.7fail
filesystem-20.8fail
iortrans-11.1
iortrans-11.2
socket-14.0
winFCmd-6.1failfail(1)failfailfailfail
winFCmd-6.9failfail(1)failfailfailfail
winFCmd-6.13failfail(1)failfailfailfail
winFCmd-9.3failfail(1)failfailfailfail
winFCmd-12.6failfail(1)failfailfailfail

Remarks

  1. Fails typically the first test run, repeating will not fail
  2. Test badly designed: failure due to existing folder C:/test

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc, build option: threads

Test8.5.19
fCmd-9.9fail
fCmd-9.11fail
filesystem-1.3fail
filesystem-1.4fail
winFCmd-6.1fail
winFCmd-6.9fail
winFCmd-6.13fail
winFCmd-9.3fail

Tcl 8.6.x edit

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc

Test8.6.08.6.18.6.28.6.38.6.4
filename-16.12fail(6)
filename-16.13fail(6)
filename-16.14fail
filename-16.15fail
filesystem-1.3failfailfailfailfail
filesystem-1.4failfailfailfailfail
filesystem-1.39fail
iortrans-11.1failfailfail
iortrans-11.2failfailfail
socket-14.0failfail
winFCmd-6.1fail(1)
winFCmd-6.9fail(1)
winFCmd-6.13fail(1)
winFCmd-9.3fail(1)
zlib-8.8fail
zlib-8.9fail(2)failfail
zlib-8.10fail(2)failfailfail
zlib-8.11fail(2)failfailfail
itcl delegatemethod-1.6afail(5)
sfbug-254failfail
sfbug-257failfail
itcl dtypemethod-1.6afail(5)
itcldmethod-1.6afail(5)
sqlite3:leapsecond.testfail
tdbc::odbc-15.2fail(3)fail(4)fail(4)
tdbc::odbc-15.3fail(3)fail(4)fail(4)
tdbc::odbc-15.4fail(3)fail(4)fail(4)
tdbc::odbc-15.5fail(3)fail(4)fail(4)
tdbc::odbc-15.6fail(3)fail(4)fail(4)
tdbc::odbc-20.1afail(4)fail(4)fail(4)
tdbc::odbc-21.2fail(4)fail(4)fail(4)
tdbc::odbc-22.3failfailfail
tdbc::odbc-25.1afail(4)fail(4)fail(4)
tdbc::odbc-27.1afail(4)fail(4)fail(4)
tdbc::odbc-27.2bfail(4)fail(4)fail(4)

Remarks

  1. Fails typically the first test run, repeating will not fail
  2. Failed only once with privileged user
  3. Transaction issues, probably due to driver
  4. Message: database is locked (5)
  5. Trivial test error, wrong error help message expected
  6. Test badly designed: failure due to existing folder C:/test

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc

Test8.6.58.6.6
chan-io-52.11fail
cmdAH-25.3.1fail
fCmd-9.9failfail
fCmd-9.11failfail
filesystem-1.3fail
filesystem-1.4fail
iortrans-11.1failfail
iortrans-11.2failfail
winFCmd-2.8failfail
sfbug-254failfail
sfbug-257failfail

Tk 8.5 edit

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc, build option:threads

Test8.5.148.5.158.5.16/178.5.18
bind-15.23fail
bitmap-4.1fail
border-3.1fail
cursor-4.1fail
font-18.1fail
spinbox-21.1failfailfail
textDisp-29.2failfailfail
textDisp-29.2.1failfailfail
textDisp-29.2.2failfailfail
textDisp-29.2.3failfailfail
textDisp-29.2.4failfailfail
textImage-3.2failfailfail
textTag-15.1failfailfailfail
winClipboard-1.2fail(1)
winClipboard-1.4fail(1)
winClipboard-1.5fail(1)
winClipboard-2.2fail(1)
wm-attributes-1.5.1fail

Remarks

  1. Win Clipboard tests feel quite unrelyable and fail with different errors. This time, the error message was 'couldn't open clipboard: Succesfully processed.' (translated from german).

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc, build option:threads

Test8.5.19
winfont-2.7fail(1)
winfont-2.8fail(1)
winfont-2.9fail(1)

Remarks

  1. Probably due to system font changes in Win 8, does not fail for Vista and Win7

Tk 8.6 edit

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc

Test8.6.08.6.18.6.28.6.38.6.4
spinbox-21.1failfailfailfail
text-19.16failfailfail
textDisp-19.11.20failfailfail
textDisp-19.11.23failfailfail
textDisp-29.2failfailfail
textDisp-29.2.1failfailfail
textDisp-29.2.2failfailfail
textDisp-29.2.3failfailfail
textDisp-29.2.4failfailfail
textImage-3.2failfailfailfail
winClipboard-1.2fail(1)
winClipboard-1.4fail(1)
winClipboard-1.5fail(1)
winClipboard-1.6fail(1)
winClipboard-2.2fail(1)
winWm-7.3fail
wm-attributes-1.5.1fail
wm-attributes-1.5.2fail
wm-attributes-1.5.4fail

Remarks

  1. Win Clipboard tests feel quite unrelyable and fail with different errors. This time, the error message was 'TK SELECTION EXISTS'.

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc, build option:threads

Test8.6.5&8.6.6
winfont-2.7fail(1)
winfont-2.8fail(1)
winfont-2.9fail(1)

Remarks

  1. Probably due to system font changes in Win 8, does not fail for Vista and Win7

Test Logs edit

I also archive (for me) the test log files build with:
nmake -f Makefile.vc test TESTFLAGS="-verbose bte" > testlog_tcl8.6.5.txt 2>&1

Drop me an E-Mail if you want to get them.