The StreamingModel interface provides a generic API for invoking an AI models
with streaming response. It abstracts the process of sending requests and receiving a
streaming responses. The interface uses Java generics to accommodate different types of
requests and responses, enhancing flexibility and adaptability across different AI
model implementations.
The StreamingModel interface provides a generic API for invoking an AI models with streaming response. It abstracts the process of sending requests and receiving a streaming responses. The interface uses Java generics to accommodate different types of requests and responses, enhancing flexibility and adaptability across different AI model implementations.