Interface: LLM<AdditionalChatOptions, AdditionalMessageOptions>

Unified language model interface

Type parameters

Name	Type
AdditionalChatOptions	extends Record<string, unknown> = Record<string, unknown>
AdditionalMessageOptions	extends Record<string, unknown> = Record<string, unknown>

Hierarchy

• LLMChat<AdditionalChatOptions>

  ↳ LLM

Implemented by

• Ollama

Properties

metadata

• metadata: LLMMetadata

Defined in

packages/core/src/llm/types.ts:61

Methods

chat

▸ chat(params): Promise<AsyncIterable<{ delta: string ; options?: Record<string, unknown> }>>

Get a chat response from the LLM

Parameters

Name	Type
params	LLMChatParamsStreaming<AdditionalChatOptions>

Returns

Promise<AsyncIterable<{ delta: string ; options?: Record<string, unknown> }>>

Overrides

LLMChat.chat

Defined in

packages/core/src/llm/types.ts:65

▸ chat(params): Promise<ChatResponse<AdditionalMessageOptions>>

Parameters

Name	Type
params	LLMChatParamsNonStreaming<AdditionalChatOptions>

Returns

Promise<ChatResponse<AdditionalMessageOptions>>

Overrides

LLMChat.chat

Defined in

packages/core/src/llm/types.ts:68

---

complete

▸ complete(params): Promise<AsyncIterable<CompletionResponse>>

Get a prompt completion from the LLM

Parameters

Name	Type
params	LLMCompletionParamsStreaming

Returns

Promise<AsyncIterable<CompletionResponse>>

Defined in

packages/core/src/llm/types.ts:75

▸ complete(params): Promise<CompletionResponse>

Parameters

Name	Type
params	LLMCompletionParamsNonStreaming

Returns

Promise<CompletionResponse>

Defined in

packages/core/src/llm/types.ts:78