Bug 15916

Summary: AB-INT PTEST: python3-hypothesis: examples/test_rle.py:test_duplicating_an_element_does_not_increase_length
Product: [QA/Testing] Package Testing (ptest) Reporter: João Marcos Costa <joaomarcos.costa>
Component: ptestAssignee: Unassigned <unassigned>
Status: RESOLVED WORKSFORME QA Contact:
Severity: normal    
Priority: Medium CC: randy.macleod, richard.purdie, yoann.congal
Version: unspecified   
Target Milestone: 6.1   
Hardware: x86   
OS: Multiple   
Whiteboard: AB-INT
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: Don't know

Description João Marcos Costa 2025-06-27 08:30:28 UTC
https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/1772/steps/12/logs/stdio

Failed ptests:{'python3-hypothesis': ['examples/test_rle.py:test_duplicating_an_element_does_not_increase_length']}

qemuarm64-ptest ubuntu2404-vk-arm2

---

+ Exception Group Traceback (most recent call last):
  |   File "/usr/lib/python3-hypothesis/ptest/examples/test_rle.py", line 84, in test_duplicating_an_element_does_not_increase_length
  |     def test_duplicating_an_element_does_not_increase_length(ls, data):
  |                    ^^^
  |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py", line 2047, in wrapped_test
  |     raise the_error_hypothesis_found
  | hypothesis.errors.FlakyFailure: Hypothesis test_duplicating_an_element_does_not_increase_length(ls=[5, 0, 1, 1, 2, 9, 2, 1, 2, 1, 1, 2, 10, 7, 8, 3, 0, 3, 0, 0, 0, 1, 2, 1, 0], data=data(...)) produces unreliable results: Falsified on the first call but did not on a subsequent one (1 sub-exception)
  | Falsifying example: test_duplicating_an_element_does_not_increase_length(
  |     ls=[5,
  |      0,
  |      1,
  |      1,
  |      2,
  |      9,
  |      2,
  |      1,
  |      2,
  |      1,
  |      1,
  |      2,
  |      10,
  |      7,
  |      8,
  |      3,
  |      0,
  |      3,
  |      0,
  |      0,
  |      0,
  |      1,
  |      2,
  |      1,
  |      0],
  |     data=data(...),
  | )
  | Draw 1: 0
  | Unreliable test timings! On an initial run, this test took 267.40ms, which exceeded the deadline of 200.00ms, but on a subsequent run it took 0.23 ms, which did not. If you expect this sort of variability in your test timings, consider turning deadlines off for this test by setting deadline=None.
  +-+---------------- 1 ----------------
    | Traceback (most recent call last):
    |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py", line 1191, in _execute_once_for_engine
    |     result = self.execute_once(data)
    |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py", line 1131, in execute_once
    |     result = self.test_runner(data, run)
    |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py", line 814, in default_executor
    |     return function(data)
    |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py", line 1087, in run
    |     return test(*args, **kwargs)
    |   File "/usr/lib/python3-hypothesis/ptest/examples/test_rle.py", line 84, in test_duplicating_an_element_does_not_increase_length
    |     def test_duplicating_an_element_does_not_increase_length(ls, data):
    |                    ^^^^^^^^^^^
    |   File "/usr/lib/python3.13/site-packages/hypothesis/core.py", line 1021, in test
    |     raise DeadlineExceeded(
    |         datetime.timedelta(seconds=runtime), self.settings.deadline
    |     )
    | hypothesis.errors.DeadlineExceeded: Test took 267.40ms, which exceeds the deadline of 200.00ms
    +------------------------------------
FAIL: examples/test_rle.py:test_duplicating_an_element_does_not_increase_length
============================================================================
Testsuite summary
# TOTAL: 5
# PASS: 4
# SKIP: 0
# XFAIL: 0
# FAIL: 1
# XPASS: 0
# ERROR: 0

ERROR: Exit status is 1
DURATION: 4
END: /usr/lib/python3-hypothesis/ptest
Comment 1 João Marcos Costa 2025-06-27 08:31:57 UTC
FYI python3-hypothesis was bumped from 6.132.0 to 6.135.9 a couple weeks ago:

commit 733b8b5460cf9489368345c32d08f25a117af780
Author: Wang Mingyu <wangmy@fujitsu.com>
Date:   Mon Jun 16 17:16:34 2025 +0800

    python3-hypothesis: upgrade 6.132.0 -> 6.135.9
    
    (From OE-Core rev: 9e861a62b8bd86419b93b1dc697ea990d03b565a)
    
    Signed-off-by: Wang Mingyu <wangmy@fujitsu.com>
    Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Comment 2 Randy MacLeod 2025-07-03 14:34:55 UTC
Let's see how frequently this problem occurs.
Comment 3 Randy MacLeod 2026-04-15 19:28:06 UTC
When we get to cleaning up old 6.0 bugs, and if this hasn't happened again, 
we should resolve it as works for me.
Comment 4 Randy MacLeod 2026-05-28 13:16:31 UTC
Bulk move of 6.0 Medium bugs to 6.1.
Comment 5 Randy MacLeod 2026-06-11 15:03:21 UTC
Not seen in > 6 months.