Interface DeepInfraEmbeddingsParams

Input parameters for the DeepInfra embeddings

interface DeepInfraEmbeddingsParams {
    apiToken?: string;
    batchSize?: number;
    modelName?: string;
}

Properties

apiToken?: string

The API token to use for authentication. If not provided, it will be read from the DEEPINFRA_API_TOKEN environment variable.

batchSize?: number

The maximum number of texts to embed in a single request. This is limited by the DeepInfra API to a maximum of 1024.

modelName?: string

The model ID to use for generating completions. Default: sentence-transformers/clip-ViT-B-32