| Summary: | python: ptest cases failed | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [Build System, Metadata & Runtime] OE-Core | Reporter: | Chong Lu <chong.lu> | ||||
| Component: | devtools / tool chain | Assignee: | Ross Burton <ross.burton> | ||||
| Status: | RESOLVED FIXED | QA Contact: | |||||
| Severity: | normal | ||||||
| Priority: | Medium | CC: | chong.lu, hongxu.jia, jose.a.lamego, jose.perez.carranza, liezhi.yang, mark.hatle, meta.mr.watcher, meta.watcher, Qi.Chen, sgw | ||||
| Version: | 1.6 | ||||||
| Target Milestone: | 2.6 | ||||||
| Hardware: | x86 | ||||||
| OS: | Multiple | ||||||
| Whiteboard: | |||||||
| OS type for building Yocto: | --- | Type of Regression: | --- | ||||
| Verified: | Documentation change: | No (bug/feature does not impact docs) | |||||
| Attachments: |
|
||||||
This will be used as a baseline to detect future regressions. Looking at the log file, looks like several tests fail due to a know issue related to the default encoding used in Yocto-build images ('utf-8') being different from the assumed 'ascii' by the tests (see bug 10522). This will no longer be the case after 2.5 M1 milestone, when manifest patches that remove the mentioned default encoding are scheduled to be implemented.
Among others, the following are in this case (UnicodeEncodeError not raised):
test_hasattr
test_0_args_with_overridden___str__
test_1_arg
test_1_arg_with_overridden___str__
test_many_args_with_overridden___str__
test_unicode
test_output_htmlcalendar
test_with_marshal
that said, it would be worth testing with the default encoding set to 'ascii' to verify this.
With a trivial tweak to the image (adding unzip) the only tests that fail are test_distutils, because they're trying to compile stuff and don't handle a compiler not being present. All merged as of oe-core d371ff04628bdf7bac66341aeb9a66d145f66416. |
Created attachment 1696 [details] python ptest log Many python ptest cases failed FAIL: test_getattr (test.test_builtin.BuiltinTest) FAIL: test_hasattr (test.test_builtin.BuiltinTest) FAIL: test_hasattr (test.test_builtin.BuiltinTest) FAIL: Check same msg for exceptions with 0 args and overridden __str__ FAIL: Check same msg for Exceptions with 1 arg FAIL: Check same msg for exceptions with overridden __str__ and 1 arg FAIL: Check same msg for exceptions with overridden __str__ and many args FAIL: test_0_args_with_overridden___str__ (test.test_exceptions.TestSameStrAndUnicodeMsg) FAIL: test_1_arg (test.test_exceptions.TestSameStrAndUnicodeMsg) FAIL: test_1_arg_with_overridden___str__ (test.test_exceptions.TestSameStrAndUnicodeMsg) FAIL: test_many_args_with_overridden___str__ (test.test_exceptions.TestSameStrAndUnicodeMsg) FAIL: test_unicode (test.test_StringIO.TestcStringIO) FAIL: test_unicode (test.test_StringIO.TestcStringIO) FAIL: test_output_htmlcalendar (test.test_calendar.OutputTestCase) FAIL: test_output_htmlcalendar (test.test_calendar.OutputTestCase) FAIL: test_basic_script (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmplNdvz5/script.py': FAIL: test_directory (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpdBKHLV': FAIL: test_directory_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpml4lor': FAIL: test_directory_error (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpEoClHp': FAIL: test_module_in_package (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpj9kmSN/launch.py': FAIL: test_module_in_package_in_zipfile (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpAP4bnX/launch.py': FAIL: test_module_in_subpackage_in_zipfile (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmppJHdeS/launch.py': FAIL: test_package (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpn6_J8g/launch.py': FAIL: test_package_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpPci0_v/launch.py': FAIL: test_package_error (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpbRB0nG/launch.py': FAIL: test_package_recursion (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpln7rS5/launch.py': FAIL: test_script_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpits5r8/script.pyc': FAIL: test_zipfile (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpWROXv_/test_zip.zip': FAIL: test_zipfile_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpZdlwQx/test_zip.zip': FAIL: test_zipfile_error (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpaUiPcd/test_zip.zip': FAIL: test_readline (test.test_codecs.UTF32Test) FAIL: test_readline (test.test_codecs.UTF32LETest) FAIL: test_readline (test.test_codecs.UTF32BETest) FAIL: test_readline (test.test_codecs.UTF16Test) FAIL: test_readline (test.test_codecs.UTF16LETest) FAIL: test_readline (test.test_codecs.UTF16BETest) FAIL: test_readline (test.test_codecs.UTF8Testest test_codecs failed -- multiple errors occurred FAIL: test_readline (test.test_codecs.UTF8SigTest) FAIL: test_readline (test.test_codecs.UTF7Test) FAIL: test_nameprep (test.test_codecs.NameprepTest) FAIL: test_readline (test.test_codecs.UTF32Test) FAIL: test_readline (test.test_codecs.UTF32LETest) FAIL: test_readline (test.test_codecs.UTF32BETest) FAIL: test_readline (test.test_codecs.UTF16Test) FAIL: test_readline (test.test_codecs.UTF16LETest) FAIL: test_readline (test.test_codecs.UTF16BETest) FAIL: test_readline (test.test_codecs.UTF8Test) FAIL: test_readline (test.test_codecs.UTF8SigTest) FAIL: test_readline (test.test_codecs.UTF7Test) FAIL: test_invalid_name (ctypes.test.test_structures.StructureTestCase) FAIL: test_invalid_name (ctypes.test.test_structures.StructureTestCase) FAIL: test_search_cpp (distutils.tests.test_config_cmd.ConfigTestCase) FAIL: test_build_ext (distutils.tests.test_build_ext.BuildExtTestCase) FAIL: test_get_outputs (distutils.tests.test_build_ext.BuildExtTestCase) FAIL: test_get_python_inc (distutils.tests.test_sysconfig.SysconfigTestCase) FAIL: test_record_extensions (distutils.tests.test_install.InstallTestCase) FAIL: test_get_python_inc (distutils.tests.test_sysconfig.SysconfigTestCase) FAIL: test_with_marshal (test.test_getargs.GetArgsTest) FAIL: test_bad_encoding (json.tests.test_unicode.TestCUnicode) FAIL: test_bad_encoding (json.tests.test_unicode.TestPyUnicode) FAIL: test_getattr (test.test_builtin.BuiltinTest) FAIL: test_hasattr (test.test_builtin.BuiltinTest) FAIL: test_hasattr (test.test_builtin.BuiltinTest) FAIL: Check same msg for exceptions with 0 args and overridden __str__ FAIL: Check same msg for Exceptions with 1 arg FAIL: Check same msg for exceptions with overridden __str__ and 1 arg FAIL: Check same msg for exceptions with overridden __str__ and many args FAIL: test_0_args_with_overridden___str__ (test.test_exceptions.TestSameStrAndUnicodeMsg) FAIL: test_1_arg (test.test_exceptions.TestSameStrAndUnicodeMsg) FAIL: test_1_arg_with_overridden___str__ (test.test_exceptions.TestSameStrAndUnicodeMsg) FAIL: test_many_args_with_overridden___str__ (test.test_exceptions.TestSameStrAndUnicodeMsg) FAIL: test_unicode (test.test_StringIO.TestcStringIO) FAIL: test_unicode (test.test_StringIO.TestcStringIO) FAIL: test_output_htmlcalendar (test.test_calendar.OutputTestCase) FAIL: test_output_htmlcalendar (test.test_calendar.OutputTestCase) FAIL: test_basic_script (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpVYOdRo/script.py': FAIL: test_directory (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpfBYQdA': FAIL: test_directory_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmp_dLmme': FAIL: test_directory_error (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpaFZ4JM': FAIL: test_module_in_package (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmp7WF7lI/launch.py': FAIL: test_module_in_package_in_zipfile (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpABk0v1/launch.py': FAIL: test_module_in_subpackage_in_zipfile (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpeL055h/launch.py': FAIL: test_package (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpsYSh6L/launch.py': FAIL: test_package_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpAJUgg8/launch.py': FAIL: test_package_error (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpsLItaa/launch.py': FAIL: test_package_recursion (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpBSPOm5/launch.py': FAIL: test_script_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpd1YrPU/script.pyc': FAIL: test_zipfile (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmp6r14sH/test_zip.zip': FAIL: test_zipfile_compiled (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpaE_GmF/test_zip.zip': FAIL: test_zipfile_error (test.test_cmd_line_script.CmdLineTest) ... Output from test script '/var/volatile/tmp/tmpUj2snp/test_zip.zip': FAIL: test_readline (test.test_codecs.UTF32Test) FAIL: test_readline (test.test_codecs.UTF32LETest) FAIL: test_readline (test.test_codecs.UTF32BETest) FAIL: test_readline (test.test_codecs.UTF16Test) FAIL: test_readline (test.test_codecs.UTF16LETest) FAIL: test_readline (test.test_codecs.UTF16BETest) FAIL: test_readline (test.test_codecs.UTF8Test) FAIL: test_readline (test.test_codecs.UTF8SigTest) FAIL: test_readline (test.test_codecs.UTF7Test) FAIL: test_nameprep (test.test_codecs.NameprepTest) FAIL: test_readline (test.test_codecs.UTF32Test) FAIL: test_readline (test.test_codecs.UTF32LETest) FAIL: test_readline (test.test_codecs.UTF32BETest) FAIL: test_readline (test.test_codecs.UTF16Test) FAIL: test_readline (test.test_codecs.UTF16LETest) FAIL: test_readline (test.test_codecs.UTF16BETest) FAIL: test_readline (test.test_codecs.UTF8Test) FAIL: test_readline (test.test_codecs.UTF8SigTest) FAIL: test_readline (test.test_codecs.UTF7Test) FAIL: test_invalid_name (ctypes.test.test_structures.StructureTestCase) FAIL: test_invalid_name (ctypes.test.test_structures.StructureTestCase) FAIL: test_search_cpp (distutils.tests.test_config_cmd.ConfigTestCase) FAIL: test_build_ext (distutils.tests.test_build_ext.BuildExtTestCase) FAIL: test_get_outputs (distutils.tests.test_build_ext.BuildExtTestCase) FAIL: test_get_python_inc (distutils.tests.test_sysconfig.SysconfigTestCase) FAIL: test_record_extensions (distutils.tests.test_install.InstallTestCase) FAIL: test_get_python_inc (distutils.tests.test_sysconfig.SysconfigTestCase) FAIL: test_with_marshal (test.test_getargs.GetArgsTest) FAIL: test_bad_encoding (json.tests.test_unicode.TestCUnicode) FAIL: test_bad_encoding (json.tests.test_unicode.TestPyUnicode) 120 test cases fail. Please check the attachment log.