Class RedisCache

Cache LLM results using Redis.

Example

const model = new ChatOpenAI({
  cache: new RedisCache(new Redis(), { ttl: 60 }),
});

// Invoke the model with a prompt
const response = await model.invoke("Do something random!");
console.log(response);

// Remember to disconnect the Redis client when done
await redisClient.disconnect();

Hierarchy (view full)

Constructors

constructor

Properties

redisClient ttl?

Methods

lookup update

Constructors

constructor

Properties

Protected redisClient

redisClient: Redis

Protected Optional ttl

ttl?: number

Methods

lookup

  • lookup(prompt, llmKey): Promise<null | Generation[]>

  • Retrieves data from the Redis server using a prompt and an LLM key. If the data is not found, it returns null.

    Parameters

    • prompt: string

      The prompt used to find the data.

    • llmKey: string

      The LLM key used to find the data.

    Returns Promise<null | Generation[]>

    The corresponding data as an array of Generation objects, or null if not found.

update

  • update(prompt, llmKey, value): Promise<void>

  • Updates the data in the Redis server using a prompt and an LLM key.

    Parameters

    • prompt: string

      The prompt used to store the data.

    • llmKey: string

      The LLM key used to store the data.

    • value: Generation[]

      The data to be stored, represented as an array of Generation objects.

    Returns Promise<void>

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc