基于显卡在大模型推理任务中的性能表现,性能排名如下: 1. **H800** 2. **A100** 3. **A800** 4. **L40/L40S** 5. **L20** 6. **A40** 7. **V100** 8. **A10** 9. **T4** ## 参考资料 - [性能比较:NVIDIA A100、H100 和 H800](https://medium.com/@KarlHavard/performance-comparison-nvidia-a100-h100-h800-04db98c58648) 得出结论H100 > H800 > A100 - [A100和A800的区别](http://www.531pool.com/index.php?m=home&c=View&a=index&aid=99) 得出结论A100 > A800 - [A100 vs V100 Deep Learning Benchmarks](https://lambdalabs.com/blog/nvidia-a100-vs-v100-benchmarks) 得出结论A100 > V100 - [Comparing NVIDIA A100 and NVIDIA L40S](https://www.hpcwire.com/2023/10/30/comparing-nvidia-a100-and-nvidia-l40s-which-gpu-is-ideal-for-ai-and-graphics-intensive-workloads/) 得出结论L40S≈A100 - [NVIDIA A40 Deep Learning Benchmarks](https://lambdalabs.com/blog/nvidia-rtx-a40-benchmarks) 得出结论A40 40G > V100 16G - [NVIDIA Tesla T4 v.s V100](https://celikmustafa89.medium.com/nvidia-tesla-t4-v-s-v100-60b94ec8f564) 得出结论V100 > T4 - [Comparing NVIDIA GPUs for AI: T4 vs A10](https://www.baseten.co/blog/comparing-nvidia-gpus-for-ai-t4-vs-a10/) 得出结论A10 > T4 - [NVIDIA-A10-PCIe-vs-NVIDIA-Tesla-V100-PCIe-32-GB](https://www.topcpu.net/gpu-c/NVIDIA-A10-PCIe-vs-NVIDIA-Tesla-V100-PCIe-32-GB) A10 V100没有对比结论,根据与其他GPU的比较,暂认为相当 - [l20-vs-l40](https://www.topcpu.net/en/soc-c/l20-vs-l40) [L20介绍](https://mp.weixin.qq.com/s/h62PnywRJT0q-8_WRbVJdg) 得出结论L40S略强于L20 这些资源将帮助你根据具体的推理任务需求选择最合适的显卡。