Skip to content

Mark IPC tests as flaky and increase child timeout#1686

Merged
rwgk merged 1 commit intoNVIDIA:mainfrom
Andy-Jost:fix-ipc-test-flaky
Feb 24, 2026
Merged

Mark IPC tests as flaky and increase child timeout#1686
rwgk merged 1 commit intoNVIDIA:mainfrom
Andy-Jost:fix-ipc-test-flaky

Conversation

@Andy-Jost
Copy link
Contributor

Summary

  • Add pytest-rerunfailures to test dependencies and apply @pytest.mark.flaky(reruns=2) to all IPC multiprocessing tests to handle intermittent timeouts on busy CI runners.
  • Increase CHILD_TIMEOUT_SEC from 20 to 30 seconds across all IPC test files.

Test plan

  • CI passes with the new flaky markers and increased timeouts

Closes #1622

Made with Cursor

Add pytest-rerunfailures to test dependencies and apply
@pytest.mark.flaky(reruns=2) to all IPC multiprocessing tests.
Increase CHILD_TIMEOUT_SEC from 20 to 30 seconds to reduce
spurious failures on busy CI runners.

Closes NVIDIA#1622

Co-authored-by: Cursor <cursoragent@cursor.com>
@Andy-Jost Andy-Jost added this to the cuda.core v0.7.0 milestone Feb 24, 2026
@Andy-Jost Andy-Jost added P0 High priority - Must do! cuda.core Everything related to the cuda.core module labels Feb 24, 2026
@Andy-Jost Andy-Jost self-assigned this Feb 24, 2026
@copy-pr-bot
Copy link
Contributor

copy-pr-bot bot commented Feb 24, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@Andy-Jost
Copy link
Contributor Author

/ok to test 97f52d6

@github-actions

This comment has been minimized.

@Andy-Jost Andy-Jost requested a review from rwgk February 24, 2026 20:38
Copy link
Collaborator

@rwgk rwgk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, thanks!

@rwgk rwgk merged commit 494f53c into NVIDIA:main Feb 24, 2026
90 checks passed
@Andy-Jost Andy-Jost deleted the fix-ipc-test-flaky branch February 24, 2026 21:44
@github-actions
Copy link

Doc Preview CI
Preview removed because the pull request was closed or merged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cuda.core Everything related to the cuda.core module P0 High priority - Must do!

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Stabilize tests with timeouts to reduce flakiness

2 participants