Skip to content

Commit

Permalink
Move Linux GPU CI pipeline to A10 (#23235)
Browse files Browse the repository at this point in the history
Move Linux GPU CI pipeline to A10 machines which are more advanced.
Retire onnxruntime-Linux-GPU-T4 machine pool.
Disable run_lean_attention test because the new machines do not have
enough shared memory.

```
skip loading trt attention kernel fmha_mhca_fp16_128_256_sm86_kernel because no enough shared memory
[E:onnxruntime:, sequential_executor.cc:505 ExecuteKernel] Non-zero status code returned while running MultiHeadAttention node. Name:'MultiHeadAttention_0' Status Message: CUDA error cudaErrorInvalidValue:invalid argument
```
  • Loading branch information
snnn authored Jan 5, 2025
1 parent 4247153 commit b7ef81a
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion onnxruntime/test/python/transformers/test_mha.py
Original file line number Diff line number Diff line change
Expand Up @@ -892,7 +892,7 @@ def test_all(self):
# Run tests sequentially to avoid out of memory issue.
self.run_mha_cpu()
self.run_mha_cuda()
self.run_lean_attention()
# self.run_lean_attention()
self.run_mha_cuda_multi_threading_default()
self.run_mha_cuda_multi_threading_cudnn()
self.run_mha_cuda_multi_threading_efficient()
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -137,7 +137,7 @@ stages:
skipComponentGovernanceDetection: true
workspace:
clean: all
pool: onnxruntime-Linux-GPU-T4
pool: Onnxruntime-Linux-A10-24G
steps:
- checkout: self
clean: true
Expand Down
2 changes: 1 addition & 1 deletion tools/ci_build/github/linux/build_cuda_ci.sh
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ BUILD_ARGS=('--config'
"--enable_pybind"
"--build_java"
"--cmake_extra_defines"
"CMAKE_CUDA_ARCHITECTURES=75"
"CMAKE_CUDA_ARCHITECTURES=86"
"onnxruntime_BUILD_UNIT_TESTS=ON"
"onnxruntime_ENABLE_CUDA_EP_INTERNAL_TESTS=ON")
if [ -x "$(command -v ninja)" ]; then
Expand Down

0 comments on commit b7ef81a

Please sign in to comment.