Struct LlmServerHandle 

pub struct LlmServerHandle { /* private fields */ }

Lifecycle manager for the local llama-server subprocess. Cloneable handle around shared interior state; one instance lives on FlowApp.

Implementations

impl LlmServerHandle

pub fn new() -> Self

pub async fn start( &self, binary: PathBuf, model_path: PathBuf, params: LlamaParams, ) -> Result<String, String>

Spawn llama-server for model_path and wait until it answers /v1/models. Returns the managed endpoint origin (http://127.0.0.1:<port>) on success. If a server is already running it is stopped first.

pub async fn stop(&self)

Stop the managed server if one is running. Idempotent.

pub fn status(&self) -> LlmServerStatus

Current status snapshot. Does not probe the network - running reflects whether we hold a live child handle.

Trait Implementations

impl Clone for LlmServerHandle

fn clone(&self) -> LlmServerHandle

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Default for LlmServerHandle

fn default() -> Self

Returns the “default value” for a type.