What is the ideal GPU horsepower required to make a specific application run at a premium? It varies by application. For some applications, it's a linear scaling capability. Four GPUs is four times better than one GPU and then for other applications, it plateaus. Perhaps by throwing more than two GPUs at the problem doesn't buy you any additional performance. The way that a lot of customers handle it today is they have fixed servers with two, four or eight GPUs inside of it, and they hope that the workload that comes in best matches one of the free servers.
https://www.youtube.com/watch?v=-6j6jUWxT9Q
#composableIT #GPUCloudComputing #AIWorkloads #MachineLearningCloud
