Skip to main content

ModelProvider

context_harness::agent_model

Trait ModelProvider 

Source 
pub trait ModelProvider: Send + Sync {
    // Required method
    fn generate<'life0, 'life1, 'async_trait>(
        &'life0 self,
        request: &'life1 ModelRequest,
    ) -> Pin<Box<dyn Future<Output = ModelResult<ModelResponse>> + Send + 'async_trait>>
       where Self: 'async_trait,
             'life0: 'async_trait,
             'life1: 'async_trait;
}
Expand description

One configured provider/model. The model name and credentials are bound at construction, so requests cannot override their registry alias’s model.

Required Methods§

Source

fn generate<'life0, 'life1, 'async_trait>( &'life0 self, request: &'life1 ModelRequest, ) -> Pin<Box<dyn Future<Output = ModelResult<ModelResponse>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Dyn Compatibility§

This trait is dyn compatible.

In older versions of Rust, dyn compatibility was called "object safety".

Implementors§