Skip to content

updates cpp cuda plugin ep to leverage CDN binaries similar to webgpu plugin ep#770

Open
prathikr wants to merge 16 commits into
mainfrom
prathikrao/cuda-cpp-ep
Open

updates cpp cuda plugin ep to leverage CDN binaries similar to webgpu plugin ep#770
prathikr wants to merge 16 commits into
mainfrom
prathikrao/cuda-cpp-ep

Conversation

@prathikr

@prathikr prathikr commented Jun 4, 2026

Copy link
Copy Markdown
Contributor
  • updates cpp core to consume cuda plugin ep
  • adjusts webgpu verifypackages so it can be shared with cuda
  • adds mapping from CUDAExecutionProvider to CudaPluginExecutionProvider

Example manifest:

{
  "cuda_deps_version": "12.8.3",
  "ort_version": "1.28.0.dev.20260608.dadd2d03",
  "packages": {
    "win-x64": {
      "ort": {
        "url": "https://foundrypackages-ffhrdhbxb7gpdreh.b02.azurefd.net/cuda_ep_ort_1.28.0.dev.20260608.dadd2d03_win-x64.zip",
        "sha256": {
          "onnxruntime_providers_cuda_plugin.dll": "F92D16FF8423CA41F1E9A99C8DC06F462EFF147C9F1EC9B292CC687419535667",
          "onnxruntime-genai-cuda.dll": "A8A0EAB3C17484E6377E4138020A66D521826898EE3AE7A4B73F89FBF86DD583"
        }
      },
      "cuda_deps": {
        "url": "https://foundrypackages-ffhrdhbxb7gpdreh.b02.azurefd.net/cuda_deps_12.8.3_win-x64.zip",
        "sha256": {
          "cudnn_adv64_9.dll": "6D66BCE22502C2582A9C0E5398EE8CC38ADDCE2C837EB6DB8786ABC650E48DD8",
          "cublas64_12.dll": "9513540E4EC4C51EE9E7304138C2CC255C29A8C181F9E80C38EFA25738BECD99",
          "cublasLt64_12.dll": "B199D1FF892A81B7FD3D57BA1781549609B41500B36008FEF326038393AD46C7",
          "cudnn_ops64_9.dll": "49487537744256A3D4365C4792B03BF31130AD1FAEA0A13EAFA219620941D837",
          "cudnn_heuristic64_9.dll": "50719EEFB6692074096BF83C87E9CD186F7CE5B953201DA33669C1277A61949B",
          "cufft64_11.dll": "F4FEA9227B14843894AD5436725F9638B172171142C95291FC6AE7A493248221",
          "cudart64_12.dll": "C2C9A9C22A9BCBA90E261825968836787B331038047A26770CFFB7A583C28344",
          "cudnn_graph64_9.dll": "82F710B01D15D20C311009721C771B76360A4954EBF7B5F4A407B0F96587F568",
          "cudnn64_9.dll": "0D1D71325EB5E91570AB8BA8E399E07BF717FFD76511B2407229A8F45E0B1305",
          "cudnn_engines_runtime_compiled64_9.dll": "8E62214495C96B93C6333C084FEC49B43F272B7E1977A12FE62275E9070647EB",
          "cudnn_engines_precompiled64_9.dll": "B410C3B42921AFC6E668FF994FCE1BF12C5A8A9B1A9445EBEE61958BF49B1E0A"
        }
      }
    }
  }

Copilot AI review requested due to automatic review settings June 4, 2026 17:46
@vercel

vercel Bot commented Jun 4, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
foundry-local Ready Ready Preview, Comment Jun 11, 2026 7:16pm

Request Review

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated 4 comments.

Comment thread sdk_v2/cpp/src/ep_detection/cuda_ep_bootstrapper.cc Outdated
Comment thread sdk_v2/cpp/src/ep_detection/cuda_ep_bootstrapper.cc Outdated
Comment thread sdk_v2/cpp/src/ep_detection/ep_detector.cc
Comment thread sdk_v2/cpp/src/catalog/static_catalog_client.cc
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants