Skip to content

test_multiprocessing_spawn.test_threads failed twice with "concurrent send_bytes() calls are not supported" on AMD64 Windows Server 2022 NoGIL 3.15 #162304

Open

Description

@vstinner

Bug report

AMD64 Windows Server 2022 NoGIL 3.15: https://buildbot.python.org/#/builders/2120/builds/703

At the first run:

test_async_timeout (test.test_multiprocessing_spawn.test_threads.WithThreadsTestPool.test_async_timeout) ... Warning -- Uncaught thread exception: ValueError
Exception in thread Thread-86 (_handle_results):
Traceback (most recent call last):
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\threading.py", line 1219, in _bootstrap_inner
    self._context.run(self.run)
    ~~~~~~~~~~~~~~~~~^^^^^^^^^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\threading.py", line 1161, in run
    self._target(*self._args, **self._kwargs)
    ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\pool.py", line 595, in _handle_results
    cache[job]._set(i, obj)
    ~~~~~~~~~~~~~~~^^^^^^^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\pool.py", line 783, in _set
    del self._cache[self._job]
        ~~~~~~~~~~~^^^^^^^^^^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\pool.py", line 171, in __delitem__
    self.notifier.put(None)
    ~~~~~~~~~~~~~~~~~^^^^^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\queues.py", line 394, in put
    self._writer.send_bytes(obj)
    ~~~~~~~~~~~~~~~~~~~~~~~^^^^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\connection.py", line 211, in send_bytes
    self._send_bytes(m[offset:offset + size])
    ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\connection.py", line 298, in _send_bytes
    raise ValueError("concurrent send_bytes() calls "
                     "are not supported")
ValueError: concurrent send_bytes() calls are not supported
ok

When the test was re-run in verbose mode:

ERROR: test_wrapped_exception (test.test_multiprocessing_spawn.test_threads.WithThreadsTestPool.test_wrapped_exception)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\contextlib.py", line 116, in inner
    return func(*args, **kwds)
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\test\_test_multiprocessing.py", line 3224, in test_wrapped_exception
    with self.Pool(1) as p:
         ~~~~~~~~~^^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\pool.py", line 739, in __exit__
    self.terminate()
    ~~~~~~~~~~~~~~^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\pool.py", line 657, in terminate
    self._terminate()
    ~~~~~~~~~~~~~~~^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\util.py", line 354, in __call__
    res = self._callback(*self._args, **self._kwargs)
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\pool.py", line 690, in _terminate_pool
    change_notifier.put(None)
    ~~~~~~~~~~~~~~~~~~~^^^^^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\queues.py", line 394, in put
    self._writer.send_bytes(obj)
    ~~~~~~~~~~~~~~~~~~~~~~~^^^^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\connection.py", line 211, in send_bytes
    self._send_bytes(m[offset:offset + size])
    ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\bbarea\3.15.itamaro-win64-srv-22-aws.x64.nogil\build\Lib\multiprocessing\connection.py", line 298, in _send_bytes
    raise ValueError("concurrent send_bytes() calls "
                     "are not supported")
ValueError: concurrent send_bytes() calls are not supported

CPython versions tested on:

3.15

Operating systems tested on:

Windows

Activity

  1. added
    type-bugAn unexpected behavior, bug, or error
    testsTests in the Lib/test dir
    on Nov 20, 2026
  2. tanloong commented on Nov 20, 2026

    @tanloong
    Contributor

    Reproduced on my Windows in ~1 minute, 116 rounds.

    This was once discussed in #130733.

    multiprocessing.SimpleQueue does not use a write lock:

    if self._wlock is None:
    # writes to a message oriented win32 pipe are atomic
    self._writer.send_bytes(obj)

    Thus more than one threads can write simultaneously. But PipeConnection supports only one pending overlapped write, which is stored in a single _send_ov. A second send_bytes() from another thread complains:

    if self._send_ov is not None:
    # A connection should only be used by a single thread
    raise ValueError("concurrent send_bytes() calls "
    "are not supported")

    Created a PR in #162335.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    testsTests in the Lib/test dirtype-bugAn unexpected behavior, bug, or error

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions