Processing
GPUs perform the calculations needed to run AI models. Different workloads need different amounts of processing capacity.
Research →Microbix rents GPUs from external providers to support its AI research and product development. Renting computing capacity is different from owning the underlying hardware.
Model size, request length, available memory, and the number of requests running at once all affect performance. A useful comparison needs to state those conditions.
GPUs perform the calculations needed to run AI models. Different workloads need different amounts of processing capacity.
Research →Models and active requests share limited memory. The amount available affects which models and request sizes a system can handle.
Performance research →When work spans several machines, the speed of their connections affects how quickly data can move between them.
Deployment options →Start with the model, expected request volume, and data requirements. Contact the team to discuss hardware and hosting options for your workload.