Skip to content

Interface: CacheOptions

How the SDK keeps prompts in memory.

Properties

ttlMs?

ts
optional ttlMs?: number;

How long a fetched prompt is served without checking for a newer production version, in milliseconds. Defaults to 30000. This is the most a promotion can take to reach an active caller.

Released under the MIT licence.