Making predictions by sending them to the cloud.
fxn.beta.predictions.remote.create
method to request a prediction to be created in the cloud:
RemoteAcceleration
when creating remote predictions:
RemoteAcceleration
:
Remote Acceleration | Notes |
---|---|
RemoteAcceleration.Auto | Automatically use the ideal remote acceleration. |
RemoteAcceleration.CPU | Predictions are run on AMD CPU servers. |
RemoteAcceleration.A40 | Predictions are run on an Nvidia A40 GPU. |
RemoteAcceleration.A100 | Predictions are run on an Nvidia A100 GPU. |
prediction.latency
).
See our pricing for more information.