Microbix

How Microbix uses GPUs

Microbix rents GPUs from external providers to support its AI research and product development. Renting computing capacity is different from owning the underlying hardware.

What affects response speed

Model size, request length, available memory, and the number of requests running at once all affect performance. A useful comparison needs to state those conditions.

Processing

GPUs perform the calculations needed to run AI models. Different workloads need different amounts of processing capacity.

Research →

Memory

Models and active requests share limited memory. The amount available affects which models and request sizes a system can handle.

Performance research →

Connections

When work spans several machines, the speed of their connections affects how quickly data can move between them.

Deployment options →

Planning a deployment

Start with the model, expected request volume, and data requirements. Contact the team to discuss hardware and hosting options for your workload.

ESC