[ET Device Support] Annotate device attributes of CUDA backend IO tensors cuda device

[Gasoonjia]

Stack from ghstack (oldest at bottom):

• [ET Device Support] DeviceAllocator interface and DeviceAllocatorRegistry #17535
• -> [ET Device Support] Annotate device attributes of CUDA backend IO tensors cuda device #18080
• [ET Device Support] Propagate device info from TensorSpec into serialized Tensor #18079
• [executorch] Propagate device metadata from partitioner result onto TensorSpecs #18078
• [ET Device Support] TensorImpl carries device info #17534
• [ET Device Support] Schema changes: device info on Tensor and buffer-level device array #17533

Update cuda backend partitioner to annotate its IO tensors as cuda device

Differential Revision: D96010436

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/18080

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 38 New Failures

As of commit c3b9a3c with merge base 5db6f22 ():

NEW FAILURES - The following jobs have failed:

• pull / unittest / linux / linux-job (gh)
  exir/tests/test_serde.py::TestSerde::test_delegate_xnnpack
• pull / unittest / macos / macos-job (gh)
  exir/tests/test_serde.py::TestSerde::test_delegate_xnnpack
• pull / unittest / windows / windows-job (gh)
  backends/xnnpack/test/recipes/test_xnnpack_recipes.py::TestXnnpackRecipes::test_8a4w_recipe
• pull / unittest-arm-backend-with-no-deps (test_pytest_ops_tosa) / linux-job (gh)
  RuntimeError: Command docker exec -t d50bc106285ad99215be75b9a14828a4fe3f72ef2eb76a4de6e883a27a33cacf /exec failed with exit code 1
• pull / unittest-editable / linux / linux-job (gh)
  exir/tests/test_serde.py::TestSerde::test_delegate_xnnpack
• pull / unittest-editable / macos / macos-job (gh)
  exir/tests/test_serde.py::TestSerde::test_delegate_xnnpack
• pull / unittest-editable / windows / windows-job (gh)
  backends/xnnpack/test/recipes/test_xnnpack_recipes.py::TestXnnpackRecipes::test_8a4w_recipe
• Test CUDA Builds / test-cuda-pybind (gemma3-4b, --quantize, google-gemma-3-4b-it-cuda-quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t 5ff0a7677243b82d07229f6befcb131a1e78b17c6e3b20bacc1ec6078666b921 /exec failed with exit code 1
• Test CUDA Builds / test-cuda-pybind (gemma3-4b, google-gemma-3-4b-it-cuda-non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t d7482a1fdb6f3da1e170bbac6bad763c39f5f9ed268d4b88ce968f12698c0c22 /exec failed with exit code 1
• Test CUDA Builds / test-cuda-pybind (qwen3-0.6b, --quantize, Qwen-Qwen3-0.6B-cuda-quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t 03e3005f6e20adca3119c8fef8227eda5bfe086c85a280122144b58641e5e907 /exec failed with exit code 1
• Test CUDA Builds / test-cuda-pybind (qwen3-0.6b, Qwen-Qwen3-0.6B-cuda-non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t 112839c0cf45f0a764e30ef48adde6db56ff5acca0d1e95b36ede11ae08c0cbc /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (google, gemma-3-4b-it, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t 426207e10d44ac3749ab294ba7f0a2dbc87646c27d29bd7f0380f30e4faae775 /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (google, gemma-3-4b-it, quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t f401636e959ee611f40220766472dd6b415fd27e43f6e98da8833c74d8b08596 /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (mistralai, Voxtral-Mini-3B-2507, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t 6f63ffab306d0f93e53d20e7f55a71333690b1cfaadf398f3687c9abc790d83f /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (mistralai, Voxtral-Mini-3B-2507, quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t 8870e0a3077a307745a0a6b8e0adc890e8ddee98396953e9a71cd81ef591def5 /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (mistralai, Voxtral-Mini-3B-2507, quantized-int4-weight-only) / linux-job (gh)
  RuntimeError: Command docker exec -t eab2c8e24572bec3f1570846f196b72b1ee5ad563ce166da7cf0e107544b4cea /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (mistralai, Voxtral-Mini-4B-Realtime-2602, quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t ef1553366bd6da8f65ca13b8888ed47031fe4b5126c03f857dc113f92cfb9eef /exec failed with exit code 134
• Test CUDA Builds / test-model-cuda-e2e (nvidia, diar_streaming_sortformer_4spk-v2, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t b9b750830782c88ec0ad49760f14883fdee5afe749dcdb6b1acfb2528c64da39 /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (nvidia, parakeet-tdt, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t cd876bcdbe07c11499d47a8a8c89f10ad765ec82bf765a41fea744547d31ec3a /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (nvidia, parakeet-tdt, quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t f957f563842faadd8912093be1c63daf59bf864f060a7f8fcd535bb9e53096d7 /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (nvidia, parakeet-tdt, quantized-int4-weight-only) / linux-job (gh)
  RuntimeError: Command docker exec -t 1318ad41cb6bdbf5c6e50bd9603c0c24dba5cf683c1e841f4b1b40be2d2a928f /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (openai, whisper-large-v3-turbo, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t 0423726244de6bdb1865ead205576d379638f7f9290b8e7a24a015d7e62ac71a /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (openai, whisper-large-v3-turbo, quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t c4cd7b838482672c5d4df435b7c81a1f11f47327ff4b64a7fc72141e68d65d26 /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (openai, whisper-large-v3-turbo, quantized-int4-weight-only) / linux-job (gh)
  RuntimeError: Command docker exec -t 9484aa908862557b51bcf54f1c24a6f37d1ab2a5a73a86d8627c435e1cfa10af /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (openai, whisper-small, non-quantized) / linux-job (gh)
  RuntimeError: Command docker exec -t 75c9d28c4f37f6120c8b18bfd100a63736bfd6e083df2c33bb9ff60216d89129 /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (openai, whisper-small, quantized-int4-tile-packed) / linux-job (gh)
  RuntimeError: Command docker exec -t feeb11770528cc95412617dcfa9c954726f72d97963750e635cc6aeb8728f4a5 /exec failed with exit code 1
• Test CUDA Builds / test-model-cuda-e2e (openai, whisper-small, quantized-int4-weight-only) / linux-job (gh)
  RuntimeError: Command docker exec -t 3ba0beb3eeaa6d4b10bdf14f1b43a6c5c920347da0cf879441822d4762b02625 /exec failed with exit code 1
• Test CUDA Builds / test-models-cuda (add_mul) / linux-job (gh)
  RuntimeError: Command docker exec -t 52b167cf093fe662064c1bbc229995c1766b98a6b49e45811297b6e363857a92 /exec failed with exit code 134
• Test CUDA Builds / test-models-cuda (add) / linux-job (gh)
  RuntimeError: Command docker exec -t 8b2af8474914e865932b84d13e09bced1c1a389cc9a089206199911a1a2809ba /exec failed with exit code 134
• Test CUDA Builds / test-models-cuda (conv1d) / linux-job (gh)
  RuntimeError: Command docker exec -t 343e1b27da42907f3efaafe1dea8e7734822a6a481eddfb9543885149d8b410c /exec failed with exit code 134
• Test CUDA Builds / test-models-cuda (linear) / linux-job (gh)
  RuntimeError: Command docker exec -t 569e98da4a723190051c36fc07982f3ae78e234968549f5bd9e32c3e536d4e41 /exec failed with exit code 134
• Test CUDA Builds / test-models-cuda (mv2) / linux-job (gh)
  RuntimeError: Command docker exec -t ec8558d7e1e79b2acbc9874d976587a80270f83b92158ff9064f9f6e13214a68 /exec failed with exit code 134
• Test CUDA Builds / test-models-cuda (mv3) / linux-job (gh)
  RuntimeError: Command docker exec -t f0d6485afae2c3537506c6a9a08f023abb949a8991f36be5a0764a9d65b59c4d /exec failed with exit code 134
• Test CUDA Builds / test-models-cuda (resnet18) / linux-job (gh)
  RuntimeError: Command docker exec -t 0b24c2aab8823999def9a32120557b186449ee87774bd9e0da3803343f433cd2 /exec failed with exit code 134
• Test CUDA Builds / test-models-cuda (sdpa) / linux-job (gh)
  RuntimeError: Command docker exec -t 07419dba8b124593413fcc99af07dca8a08ac70c26e4c6ee6247d3a150f29c00 /exec failed with exit code 134
• Test CUDA Builds / unittest-cuda / linux-job (gh)
  RuntimeError: Command docker exec -t c699b03506b18f5556ba93b9c6443a37ebfb5a80d2c1e6fe74fbf172236f027c /exec failed with exit code 135
• Test CUDA Windows Export and E2E / test-model-cuda-windows-e2e (nvidia, diar_streaming_sortformer_4spk-v2, non-quantized) / windows-job (gh)
  Process completed with exit code 1.
• Test Metal Backend / export-model-metal-artifact (mistralai, Voxtral-Mini-4B-Realtime-2602, quantized-int4-metal) / macos-job (gh)
  RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

This PR needs a release notes: label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.