API Reference

List of the currently available LLMs on CogCache

NameValue (a.k.a COGCACHE_LLM_MODEL)
OpenAI GPT-4ogpt-4o-2024-08-06
OpenAI GPT-4o minigpt-4o-mini-2024-07-18
OpenAI GPT-4-Turbo-1106gpt-4-1106-preview
OpenAI GPT-35-Turbo-0125gpt-35-turbo-0125
Meta Llama 3 8Bllama3-8b-8192
Meta Llama 3 70Bllama3-70b-8192
Meta Llama 3.1 70B Versatile 128kllama-3.1-70b-versatile
Meta Llama 3.1 8B Instant 128kllama-3.1-8b-instant
Meta Llama 3.2 1B (Preview)llama-3.2-1b-preview
Meta Llama 3.2 3B (Preview)llama-3.2-3b-preview
Meta Llama 3.2 11B Vision (Preview)llama-3.2-11b-vision-preview
Mixtral 8x7B SMoEmixtral-8x7b-32768
Google Gemma 2 9Bgemma2-9b-it

If you need a model that you can't find it in the table above, send us a request here.