PaddlePaddle / PaddlePaddle/FastDeploy

How to deploy ERNIE-4.5-300B-A47B-Paddle on 16 GPUs

Open
#2,649 5 comments 0 reactions 1 assignee View on GitHub

@juncaipeng is already working on this.

Since Jun 30, 2025.

Dominant language
Python
Stars
3.7k
Forks
756
Avg merge
19h 28m
Merged PRs (30d)
4

Description

The guide somehow only mention the method to deploy with 8 x 80G GPUs, however the bf16 version need 2 nodes of 8 x 80G GPUs.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.