The Linux Foundation is a non-profit consortium dedicated to fostering the growth of Linux.
QmtestCplusplus3
From The Linux Foundation
LSB 3: C++ Testsuite Results and Analysis
Add newest info at the top.
03 May 2005
qmtest_libstdcpp-3.4.3-0 rpm package on Mandriva Linux 2006.0 x86 (cooker), gcc 3.4.3
--- TESTS THAT DID NOT PASS -------------------------------------------------- /27_io/fpos/14320-1.cc 1 FAIL /27_io/objects/char/12048-5.cc 1 FAIL /27_io/objects/wchar_t/12048-5.cc 1 FAIL --- STATISTICS --------------------------------------------------------------- Total Tests Passed: 1404 Total Tests Failed (including waived): 3 Total Tests Failed (excluding waived): 3
16 March 2005
Investigating the code, these tests are expected to fail:
22_locale/locale/cons/12658_thread.cc 26_numerics/c99_classification_macros_c.cc (compile) 27_io/fpos/mbstate_t/4_neg.cc 27_io/fpos/14320-1.cc 27_io/objects/char/12048-5.cc 27_io/objects/wchar_t/12048-5.cc
I had misunderstood the logic here, expected-fail means the testsuite maintainers know it will fail, not that it's a negative test. So while these are real problems, they're not indicating different behavior than the ABI.
10 March 2005
ia32 build results: gcc 3.4.2 on FC2
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 25_algorithms/find_first_of/concept_check_1.cc: FAIL : 26_numerics/c99_classification_macros_c.cc : FAIL : 27_io/fpos/14320-1.cc : FAIL : 27_io/fpos/mbstate_t/4_neg.cc : FAIL : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL : ext/enc_filebuf/char/13189.cc : FAIL : ext/enc_filebuf/wchar_t/13189.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 8 ( 1%) tests FAIL : 1399 ( 99%) tests PASS
ia32 runtime results: gcc 3.4.2 on FC2
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 27_io/fpos/14320-1.cc : FAIL : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 3 ( 0%) tests FAIL : 102 ( 7%) tests UNTESTED : 1302 ( 93%) tests PASS
x86_64 build results: gcc 3.4.3 on RHEL4
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 26_numerics/c99_classification_macros_c.cc : FAIL : 27_io/fpos/mbstate_t/4_neg.cc : FAIL : 27_io/ios_base/cons/assign_neg.cc : FAIL : 27_io/ios_base/cons/copy_neg.cc : FAIL : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL : ext/enc_filebuf/char/13189.cc : FAIL : ext/enc_filebuf/wchar_t/13189.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 8 ( 1%) tests FAIL : 1399 ( 99%) tests PASS
x86_64 runtime results: gcc 3.4.3 on RHEL4
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL : --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 2 ( 0%) tests FAIL : 102 ( 7%) tests UNTESTED : 1303 ( 93%) tests PASS
ia_64 build results: gcc 3.4.3 on RHEL4
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 25_algorithms/min_max.cc : FAIL : 26_numerics/complex/13450.cc : FAIL : 26_numerics/complex/pow.cc : FAIL : 27_io/fpos/mbstate_t/4_neg.cc : FAIL : 27_io/ios_base/cons/assign_neg.cc : FAIL : 27_io/ios_base/cons/copy_neg.cc : FAIL : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 8 ( 1%) tests FAIL : 1399 ( 99%) tests PASS
ia_64 runtime results: gcc 3.4.3 on RHEL4
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 2 ( 0%) tests FAIL : 102 ( 7%) tests UNTESTED : 1303 ( 93%) tests PASS
ppc build results: gcc 3.4.3 on RHEL4
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 26_numerics/c99_classification_macros_c.cc : FAIL : 27_io/fpos/14320-1.cc : FAIL : 27_io/fpos/mbstate_t/4_neg.cc : FAIL : 27_io/ios_base/cons/assign_neg.cc : FAIL : 27_io/ios_base/cons/copy_neg.cc : FAIL : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL : ext/enc_filebuf/char/13189.cc : FAIL : ext/enc_filebuf/wchar_t/13189.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 9 ( 1%) tests FAIL : 1398 ( 99%) tests PASS
ppc runtime results: gcc 3.4.3 on RHEL4
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 27_io/fpos/14320-1.cc : FAIL : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 3 ( 0%) tests FAIL : 102 ( 7%) tests UNTESTED : 1302 ( 93%) tests PASS
ppc64 build results: gcc 3.4.3 on RHEL4
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 26_numerics/c99_classification_macros_c.cc : FAIL : 27_io/fpos/mbstate_t/4_neg.cc : FAIL : 27_io/ios_base/cons/assign_neg.cc : FAIL : 27_io/ios_base/cons/copy_neg.cc : FAIL : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL : ext/enc_filebuf/char/13189.cc : FAIL : ext/enc_filebuf/wchar_t/13189.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 8 ( 1%) tests FAIL : 1399 ( 99%) tests PASS
ppc64 runtime results: gcc 3.4.3 on RHEL4
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 2 ( 0%) tests FAIL : 102 ( 7%) tests UNTESTED : 1303 ( 93%) tests PASS
s390 build results: gcc 3.4.3 on RHEL4
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 27_io/fpos/14320-1.cc : FAIL : 27_io/fpos/mbstate_t/4_neg.cc : FAIL : 27_io/ios_base/cons/assign_neg.cc : FAIL : 27_io/ios_base/cons/copy_neg.cc : FAIL : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 6 ( 0%) tests FAIL : 1401 (100%) tests PASS
s390 runtime results: gcc 3.4.3 on RHEL4
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 27_io/fpos/14320-1.cc : FAIL : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 3 ( 0%) tests FAIL : 102 ( 7%) tests UNTESTED : 1302 ( 93%) tests PASS
s390x build results: gcc 3.4.3 on RHEL4
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 26_numerics/c99_classification_macros_c.cc : FAIL : 27_io/fpos/mbstate_t/4_neg.cc : FAIL : 27_io/ios_base/cons/assign_neg.cc : FAIL : 27_io/ios_base/cons/copy_neg.cc : FAIL : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL : ext/enc_filebuf/char/13189.cc : FAIL : ext/enc_filebuf/wchar_t/13189.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 8 ( 1%) tests FAIL : 1399 ( 99%) tests PASS
s390x runtime results: gcc 3.4.3 on RHEL4
--- TESTS THAT DID NOT PASS -------------------------------------------------- : 27_io/objects/char/12048-5.cc : FAIL : 27_io/objects/wchar_t/12048-5.cc : FAIL --- STATISTICS --------------------------------------------------------------- : 1407 tests total : 2 ( 0%) tests FAIL : 102 ( 7%) tests UNTESTED : 1303 ( 93%) tests PASS
23 Feb 2005
build_v3_disthas been updated and run successfully and the cvs tree synced up with the changes made. Database/stub library and
missing_data.txtupdated with the symbol problems found.
ia32/mdk101 build results:
--- TESTS THAT DID NOT PASS -------------------------- : 24_iterators/istreambuf_iterator/2.cc : FAIL : 26_numerics/c99_classification_macros_c.cc : FAIL : 27_io/basic_stringbuf/overflow/char/1.cc : FAIL : 27_io/fpos/mbstate_t/4_neg.cc : FAIL : 27_io/ios_base/sync_with_stdio/16959.cc : FAIL : ext/enc_filebuf/char/13189.cc : FAIL : ext/enc_filebuf/wchar_t/13189.cc : FAIL : ext/pool_allocator/allocate_chunk.cc : FAIL --- STATISTICS --------------------------------------- : 1407 tests total : 8 ( 1%) tests FAIL : 1399 ( 99%) tests PASS
ia32/mdk101 runtime results (untested results omitted):
--- TESTS THAT DID NOT PASS -------------------------- : 24_iterators/istreambuf_iterator/2.cc : FAIL : 27_io/basic_stringbuf/overflow/char/1.cc : FAIL : 27_io/ios_base/sync_with_stdio/16959.cc : FAIL --- STATISTICS --------------------------------------- : 1407 tests total : 3 ( 0%) tests FAIL : 102 ( 7%) tests UNTESTED : 1302 ( 93%) tests PASS
x86_64/fc3 build results:
--- TESTS THAT DID NOT PASS -------------------------- : 24_iterators/istreambuf_iterator/2.cc : FAIL : 26_numerics/c99_classification_macros_c.cc : FAIL : 27_io/fpos/mbstate_t/4_neg.cc : FAIL : ext/enc_filebuf/char/13189.cc : FAIL : ext/enc_filebuf/wchar_t/13189.cc : FAIL : ext/pool_allocator/allocate_chunk.cc : FAIL --- STATISTICS --------------------------------------- : 1407 tests total : 6 ( 0%) tests FAIL : 1401 (100%) tests PASS
x86_64/fc3 runtime results (untested results omitted):
--- TESTS THAT DID NOT PASS -------------------------- : 24_iterators/istreambuf_iterator/2.cc : FAIL --- STATISTICS --------------------------------------- : 1407 tests total : 1 ( 0%) tests FAIL : 102 ( 7%) tests UNTESTED : 1304 ( 93%) tests PASS
18 Feb 2005
A build 18 Feb against a gcc 3.4.1 ia32 (Mdk 10.1) platform reported for the build pass:
: 1402 tests total : 1 ( 0%) tests ERROR : 85 ( 6%) tests FAIL : 1316 ( 94%) tests PASS
And for the run pass:
: 1402 tests total : 1 ( 0%) tests ERROR : 75 ( 5%) tests FAIL : 101 ( 7%) tests UNTESTED : 1225 ( 87%) tests PASS
The same source/tools were used for a gcc 3.4.2 x86_64 (fc3) platform with these results:
: 1402 tests total : 1 ( 0%) tests ERROR : 92 ( 7%) tests FAIL : 1309 ( 93%) tests PASS
: 1402 tests total : 1 ( 0%) tests ERROR : 82 ( 6%) tests FAIL : 101 ( 7%) tests UNTESTED : 1218 ( 87%) tests PASSThese will not be listed here individually as a lot of the trouble breaks down to size mismatches: stub libstdc++ having different sizes than the runtime library. In both cases, the following five symbols account for all of those reports, they are in the DB with size zero, and don't have the stub library size updated by
missing_data.txt(all new 3.4 symbols). This will be rerun when the stub is corrected.
_ZNSbIwSt11char_traitsIwESaIwEE4_Rep20_S_empty_rep_storageE _ZNSs4_Rep20_S_empty_rep_storageE _ZNSt10money_base8_S_atomsE _ZNSt17__timepunct_cacheIwE12_S_timezonesE _ZTVN9__gnu_cxx18stdio_sync_filebufIwSt11char_traitsIwEEEThe error comes from not building
abi_checkwhich is now no longer a single-source-file program, but as we don't configure in the directory, there is no makefile bug 709. There are also compile fails due to
LOCALEDIRnot being defined; this is related to the previous problem as the
scriptsdirectory has a file (
testsuite_flags, generated from
testsuite_flags.in) which is supposed to supply this to the build, and this is also not happening since configure is not run. It is believed that at least the latter can be fixed by running
build_v3_dist, which does not currently seem to work on this tree and thus has not been run.
[[[QmtestCplusplus3]]/Comments User Comments] [[Include(QmtestCplusplus3/Comments)]]