Skip to content

Commit 9ff2dfb

Browse files
ZhangYulonggZhangYulongg
authored
Create eb45-8k-fp8-tp1-dp8_ep.yaml (PaddlePaddle#3485)
混合架构EP并行yaml
1 parent 33d3695 commit 9ff2dfb

1 file changed

Lines changed: 6 additions & 0 deletions

File tree

‎benchmarks/yaml/eb45-8k-fp8-tp1-dp8_ep.yaml‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
num_gpu_blocks_override: 1024
2+
max_model_len: 8192
3+
max_num_seqs: 64
4+
data_parallel_size: 8
5+
tensor_parallel_size: 1
6+
enable_expert_parallel: True

0 commit comments

Comments
 (0)