The model startup using vllm failed.
9
#5 opened 8 days ago
by
beausoft
can this model be Quantized?
3
#4 opened 22 days ago
by
tinging
Sadly, Amperes are not supported😢
🚀
😔
3
#3 opened about 1 month ago
by
Saaiet
Did someone get it running on 4 NVIDIA RTX PRO 6000 Blackwell (96 GB) GPUs?
👍
3
#2 opened about 1 month ago
by
FabianHeller
Aww Man!
20
#1 opened about 1 month ago
by
mtcl