Skip to main content

CloudAiRequest

Struct CloudAiRequest 

Source
pub struct CloudAiRequest {
Show 16 fields pub model: String, pub prompt: String, pub max_tokens: Option<u32>, pub temperature: Option<f32>, pub api_key: String, pub system: Option<String>, pub base_url: Option<String>, pub top_p: Option<f32>, pub top_k: Option<u32>, pub stop: Option<Vec<String>>, pub stream: bool, pub call_id: Option<String>, pub reasoning: Option<bool>, pub images: Vec<String>, pub tools: Vec<ToolSpec>, pub response_schema: Option<Value>,
}

Fields§

§model: String§prompt: String§max_tokens: Option<u32>§temperature: Option<f32>§api_key: String§system: Option<String>

Optional system-role text. Each provider maps it to its native shape:

  • Claude: top-level system field on the request payload.
  • OpenAI: prepended {role:"system"} message.
  • Gemini: top-level system_instruction.

None sends a single user-role message with no system text - the cloud-AI node path, which has no per-task system prompt.

§base_url: Option<String>

Override endpoint for the OpenAI-compatible local provider (e.g. http://localhost:11434/v1/chat/completions). Cloud providers ignore this and use their fixed ENDPOINT const; the local provider requires it.

§top_p: Option<f32>

Nucleus sampling cutoff (0..=1). Forwarded by the OpenAI-compatible body builder (top_p); cloud providers with their own builders (Claude, Gemini) ignore it. None means “let the server decide”.

§top_k: Option<u32>

Top-K sampling cutoff. Non-standard in OpenAI’s API but accepted by llama.cpp / Ollama / LM Studio; the OpenAI-compatible body builder forwards it verbatim when set.

§stop: Option<Vec<String>>

Stop sequences (any element halts generation). Forwarded as the OpenAI stop field. Empty None means no caller-supplied stops.

§stream: bool

When true the caller is invoking the provider’s invoke_stream path and expects per-chunk events. Providers always set stream: true in the HTTP payload when this is set.

§call_id: Option<String>

Caller-supplied correlation id stamped onto every emitted LlmStreamEvent. Required when stream = true; harmless otherwise.

§reasoning: Option<bool>

Per-request reasoning/thinking toggle for models that support it. Some(true) asks the provider to enable extended thinking, Some(false) disables it, None leaves the server/model default. Each provider maps it to its native shape (OpenAI-compat chat_template_kwargs, Claude thinking, Gemini thinkingConfig).

§images: Vec<String>

Image references for vision models - http(s) URLs or data: URLs (the executor resolves local paths to base64 data: URLs before building the request). Empty for text-only calls.

§tools: Vec<ToolSpec>

Tool/function specs the model may call. Empty disables tool use; the actual call loop runs in CloudAiProvider::invoke_tools.

§response_schema: Option<Value>

Optional JSON Schema for structured output. When set, the OpenAI-compatible body builder adds a response_format: json_schema so the model is constrained to matching JSON (providers with their own body builders - Claude / Gemini - ignore it and rely on the prompt). The "structured" task sets this from the node’s outputSchema.

Trait Implementations§

Source§

impl Clone for CloudAiRequest

Source§

fn clone(&self) -> CloudAiRequest

Returns a duplicate of the value. Read more
1.0.0 · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for CloudAiRequest

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl Default for CloudAiRequest

Source§

fn default() -> CloudAiRequest

Returns the “default value” for a type. Read more
Source§

impl<'de> Deserialize<'de> for CloudAiRequest

Source§

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more
Source§

impl Serialize for CloudAiRequest

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

§

impl<T> PolicyExt for T
where T: ?Sized,

§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns [Action::Follow] only if self and other return Action::Follow. Read more
§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns [Action::Follow] if either self or other returns Action::Follow. Read more
Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more
Source§

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,

§

impl<A, B, T> HttpServerConnExec<A, B> for T
where B: Body,