Interface LlamaCppCallOptions

interface LlamaCppCallOptions {
maxTokens?: number;
onToken?: ((tokens) => void);
}

Hierarchy (view full)

Toolkit
- LlamaCppCallOptions

Index

Properties

maxTokens? onToken?

Properties

`Optional` maxTokens

maxTokens?: number

The maximum number of tokens the response should contain.

`Optional` onToken

onToken?: ((tokens) => void)

A function called when matching the provided token array

Type declaration

- (tokens): void
- A function called when matching the provided token array
  Parameters
  - tokens: number[]
  Returns void

Generated using TypeDoc