5695 – python: ptest cases failed

Bug 5695 - python: ptest cases failed

Summary: python: ptest cases failed

Status:	RESOLVED FIXED

Alias:	None

Product:	OE-Core
Classification:	Build System, Metadata & Runtime
Component:	devtools / tool chain (show other bugs)
Version:	1.6
Hardware:	x86 Multiple

Importance:	Medium normal
Target Milestone:	2.6
Assignee:	Ross Burton
QA Contact:

URL:
Whiteboard:

Depends on:
Blocks:

Reported:	2013-12-31 07:47 UTC by Chong Lu
Modified:	2018-10-15 13:53 UTC (History)
CC List:	10 users (show)

See Also:
OS type for building Yocto:	---
Type of Regression:	---
Verified:
Documentation change:	No (bug/feature does not impact docs)

Attachments
python ptest log (1.88 MB, text/x-log) 2013-12-31 07:47 UTC, Chong Lu	no flags	Details
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.

Description Chong Lu 2013-12-31 07:47:10 UTC

Created attachment 1696 [details]
python ptest log

Many python ptest cases failed

FAIL: test_getattr (test.test_builtin.BuiltinTest)
FAIL: test_hasattr (test.test_builtin.BuiltinTest)
FAIL: test_hasattr (test.test_builtin.BuiltinTest)
FAIL: Check same msg for exceptions with 0 args and overridden __str__
FAIL: Check same msg for Exceptions with 1 arg
FAIL: Check same msg for exceptions with overridden __str__ and 1 arg
FAIL: Check same msg for exceptions with overridden __str__ and many args
FAIL: test_0_args_with_overridden___str__ (test.test_exceptions.TestSameStrAndUnicodeMsg)
FAIL: test_1_arg (test.test_exceptions.TestSameStrAndUnicodeMsg)
FAIL: test_1_arg_with_overridden___str__ (test.test_exceptions.TestSameStrAndUnicodeMsg)
FAIL: test_many_args_with_overridden___str__ (test.test_exceptions.TestSameStrAndUnicodeMsg)
FAIL: test_unicode (test.test_StringIO.TestcStringIO)
FAIL: test_unicode (test.test_StringIO.TestcStringIO)
FAIL: test_output_htmlcalendar (test.test_calendar.OutputTestCase)
FAIL: test_output_htmlcalendar (test.test_calendar.OutputTestCase)
FAIL: test_basic_script (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmplNdvz5/script.py':
FAIL: test_directory (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpdBKHLV':
FAIL: test_directory_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpml4lor':
FAIL: test_directory_error (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpEoClHp':
FAIL: test_module_in_package (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpj9kmSN/launch.py':
FAIL: test_module_in_package_in_zipfile (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpAP4bnX/launch.py':
FAIL: test_module_in_subpackage_in_zipfile (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmppJHdeS/launch.py':
FAIL: test_package (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpn6_J8g/launch.py':
FAIL: test_package_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpPci0_v/launch.py':
FAIL: test_package_error (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpbRB0nG/launch.py':
FAIL: test_package_recursion (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpln7rS5/launch.py':
FAIL: test_script_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpits5r8/script.pyc':
FAIL: test_zipfile (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpWROXv_/test_zip.zip':
FAIL: test_zipfile_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpZdlwQx/test_zip.zip':
FAIL: test_zipfile_error (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpaUiPcd/test_zip.zip':
FAIL: test_readline (test.test_codecs.UTF32Test)
FAIL: test_readline (test.test_codecs.UTF32LETest)
FAIL: test_readline (test.test_codecs.UTF32BETest)
FAIL: test_readline (test.test_codecs.UTF16Test)
FAIL: test_readline (test.test_codecs.UTF16LETest)
FAIL: test_readline (test.test_codecs.UTF16BETest)
FAIL: test_readline (test.test_codecs.UTF8Testest test_codecs failed -- multiple errors occurred
FAIL: test_readline (test.test_codecs.UTF8SigTest)
FAIL: test_readline (test.test_codecs.UTF7Test)
FAIL: test_nameprep (test.test_codecs.NameprepTest)
FAIL: test_readline (test.test_codecs.UTF32Test)
FAIL: test_readline (test.test_codecs.UTF32LETest)
FAIL: test_readline (test.test_codecs.UTF32BETest)
FAIL: test_readline (test.test_codecs.UTF16Test)
FAIL: test_readline (test.test_codecs.UTF16LETest)
FAIL: test_readline (test.test_codecs.UTF16BETest)
FAIL: test_readline (test.test_codecs.UTF8Test)
FAIL: test_readline (test.test_codecs.UTF8SigTest)
FAIL: test_readline (test.test_codecs.UTF7Test)
FAIL: test_invalid_name (ctypes.test.test_structures.StructureTestCase)
FAIL: test_invalid_name (ctypes.test.test_structures.StructureTestCase)
FAIL: test_search_cpp (distutils.tests.test_config_cmd.ConfigTestCase)
FAIL: test_build_ext (distutils.tests.test_build_ext.BuildExtTestCase)
FAIL: test_get_outputs (distutils.tests.test_build_ext.BuildExtTestCase)
FAIL: test_get_python_inc (distutils.tests.test_sysconfig.SysconfigTestCase)
FAIL: test_record_extensions (distutils.tests.test_install.InstallTestCase)
FAIL: test_get_python_inc (distutils.tests.test_sysconfig.SysconfigTestCase)
FAIL: test_with_marshal (test.test_getargs.GetArgsTest)
FAIL: test_bad_encoding (json.tests.test_unicode.TestCUnicode)
FAIL: test_bad_encoding (json.tests.test_unicode.TestPyUnicode)
FAIL: test_getattr (test.test_builtin.BuiltinTest)
FAIL: test_hasattr (test.test_builtin.BuiltinTest)
FAIL: test_hasattr (test.test_builtin.BuiltinTest)
FAIL: Check same msg for exceptions with 0 args and overridden __str__
FAIL: Check same msg for Exceptions with 1 arg
FAIL: Check same msg for exceptions with overridden __str__ and 1 arg
FAIL: Check same msg for exceptions with overridden __str__ and many args
FAIL: test_0_args_with_overridden___str__ (test.test_exceptions.TestSameStrAndUnicodeMsg)
FAIL: test_1_arg (test.test_exceptions.TestSameStrAndUnicodeMsg)
FAIL: test_1_arg_with_overridden___str__ (test.test_exceptions.TestSameStrAndUnicodeMsg)
FAIL: test_many_args_with_overridden___str__ (test.test_exceptions.TestSameStrAndUnicodeMsg)
FAIL: test_unicode (test.test_StringIO.TestcStringIO)
FAIL: test_unicode (test.test_StringIO.TestcStringIO)
FAIL: test_output_htmlcalendar (test.test_calendar.OutputTestCase)
FAIL: test_output_htmlcalendar (test.test_calendar.OutputTestCase)
FAIL: test_basic_script (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpVYOdRo/script.py':
FAIL: test_directory (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpfBYQdA':
FAIL: test_directory_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmp_dLmme':
FAIL: test_directory_error (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpaFZ4JM':
FAIL: test_module_in_package (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmp7WF7lI/launch.py':
FAIL: test_module_in_package_in_zipfile (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpABk0v1/launch.py':
FAIL: test_module_in_subpackage_in_zipfile (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpeL055h/launch.py':
FAIL: test_package (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpsYSh6L/launch.py':
FAIL: test_package_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpAJUgg8/launch.py':
FAIL: test_package_error (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpsLItaa/launch.py':
FAIL: test_package_recursion (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpBSPOm5/launch.py':
FAIL: test_script_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpd1YrPU/script.pyc':
FAIL: test_zipfile (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmp6r14sH/test_zip.zip':
FAIL: test_zipfile_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpaE_GmF/test_zip.zip':
FAIL: test_zipfile_error (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpUj2snp/test_zip.zip':
FAIL: test_readline (test.test_codecs.UTF32Test)
FAIL: test_readline (test.test_codecs.UTF32LETest)
FAIL: test_readline (test.test_codecs.UTF32BETest)
FAIL: test_readline (test.test_codecs.UTF16Test)
FAIL: test_readline (test.test_codecs.UTF16LETest)
FAIL: test_readline (test.test_codecs.UTF16BETest)
FAIL: test_readline (test.test_codecs.UTF8Test)
FAIL: test_readline (test.test_codecs.UTF8SigTest)
FAIL: test_readline (test.test_codecs.UTF7Test)
FAIL: test_nameprep (test.test_codecs.NameprepTest)
FAIL: test_readline (test.test_codecs.UTF32Test)
FAIL: test_readline (test.test_codecs.UTF32LETest)
FAIL: test_readline (test.test_codecs.UTF32BETest)
FAIL: test_readline (test.test_codecs.UTF16Test)
FAIL: test_readline (test.test_codecs.UTF16LETest)
FAIL: test_readline (test.test_codecs.UTF16BETest)
FAIL: test_readline (test.test_codecs.UTF8Test)
FAIL: test_readline (test.test_codecs.UTF8SigTest)
FAIL: test_readline (test.test_codecs.UTF7Test)
FAIL: test_invalid_name (ctypes.test.test_structures.StructureTestCase)
FAIL: test_invalid_name (ctypes.test.test_structures.StructureTestCase)
FAIL: test_search_cpp (distutils.tests.test_config_cmd.ConfigTestCase)
FAIL: test_build_ext (distutils.tests.test_build_ext.BuildExtTestCase)
FAIL: test_get_outputs (distutils.tests.test_build_ext.BuildExtTestCase)
FAIL: test_get_python_inc (distutils.tests.test_sysconfig.SysconfigTestCase)
FAIL: test_record_extensions (distutils.tests.test_install.InstallTestCase)
FAIL: test_get_python_inc (distutils.tests.test_sysconfig.SysconfigTestCase)
FAIL: test_with_marshal (test.test_getargs.GetArgsTest)
FAIL: test_bad_encoding (json.tests.test_unicode.TestCUnicode)
FAIL: test_bad_encoding (json.tests.test_unicode.TestPyUnicode)

120 test cases fail. Please check the attachment log.

Comment 1 Laurentiu Palcu 2014-01-13 09:39:54 UTC

This will be used as a baseline to detect future regressions.

Comment 2 Jose Lamego 2017-11-09 00:08:43 UTC

Looking at the log file, looks like several tests fail due to a know issue related to the default encoding used in Yocto-build images ('utf-8') being different from the assumed 'ascii' by the tests (see bug 10522). This will no longer be the case after 2.5 M1 milestone, when manifest patches that remove the mentioned default encoding are scheduled to be implemented.

Among others, the following are in this case (UnicodeEncodeError not raised):

test_hasattr
test_0_args_with_overridden___str__
test_1_arg
test_1_arg_with_overridden___str__
test_many_args_with_overridden___str__
test_unicode
test_output_htmlcalendar
test_with_marshal

that said, it would be worth testing with the default encoding set to 'ascii' to verify this.

Comment 3 Ross Burton 2018-10-11 21:48:08 UTC

With a trivial tweak to the image (adding unzip) the only tests that fail are test_distutils, because they're trying to compile stuff and don't handle a compiler not being present.

Comment 4 Ross Burton 2018-10-15 13:53:09 UTC

All merged as of oe-core d371ff04628bdf7bac66341aeb9a66d145f66416.