How to choose the right GPU?
JimmyWong
Last Update 10 maanden geleden
Due to the costs associated with GPUs, including their startup times, a higher-performance GPU does not necessarily mean faster image generation speeds. Here are some recommendations:
- If you are using the SDXL model and generating images larger than 1024*1024, we strongly recommend using the A10G. If you're using the SD 1.5 model, you can use either the T4 or A10G.
- If you need to generate videos, we recommend using the A100.
The following are our test results for generating a 512x512 image using the SD 1.5 model with the default workflow (note that the times listed are average times; actual results may vary slightly):
| GPU | Time |
|---|---|
| T4 | 29.6s |
| L4 | 33.5s |
| A10G | 22.8s |
| A100(40G) | 26.3s |
SDXL model test results:
| GPU | Time |
|---|---|
| T4 | 63.7s |
| L4 | 54s |
| A10G | 44.8s |
| A100(40G) | 43s |
Test results for generating videos using the SVD model:
| GPU | Time |
|---|---|
| T4 | 323.3s |
| L4 | 200.08s |
| A10G | 135.3s |
| A100(40G) | 52.8s |