Deploying Python functions
You can deploy Python functions in watsonx.ai Runtime the same way that you can deploy models. Your tools and apps can use the watsonx.ai Python client or REST API to send data to your deployed functions the same way that they send data to deployed models. Deploying Python functions gives you the ability to hide details (such as credentials). You can also preprocess data before you pass it to models. Additionally, you can handle errors and include calls to multiple models, all within the deployed function instead of in your application.
Sample notebooks for creating and deploying Python functions
For examples of how to create and deploy Python functions by using the watsonx.ai Python client library, refer to these sample notebooks that are published in Resource hub:
- Predict business for cars
- Deploy Python function for software specification
You can access the Resource hub by selecting Resource hub from the main navigation menu.
The notebooks demonstrate the six steps for creating and deploying a function:
- Define the function
- Authenticate and define a space
- Store the function in the repository
- Get the software specification
- Deploy the stored function
- Send data to the function for processing
For links to other sample notebooks that use the watsonx.ai Python client library, refer to Using watsonx.ai Runtime in a notebook.
Increasing scalability for a function
When you deploy a function from a deployment space or programmatically, a single copy of the function is deployed by default. To increase scalability, you can increase the number of replicas by editing the configuration of the deployment. More replicas allow for a larger volume of scoring requests.
The following example uses the Python client API to set the number of replicas to 3.
change_meta = {
client.deployments.ConfigurationMetaNames.HARDWARE_SPEC: {
"name":"S",
"num_nodes":3}
}
client.deployments.update(<deployment_id>, change_meta)
Learn more
- To learn more about defining a deployable Python function, see General requirements for deployable functions section in Writing and storing deployable Python functions.
- You can deploy a function from a deployment space through the user interface. For more information, see Deployment spaces.
Parent topic: Managing predictive deployments