API Reference

List of the currently available LLMs on CogCache

NameValue (a.k.a COGCACHE_LLM_MODEL)
OpenAI GPT-4ogpt-4o-2024-05-13
OpenAI GPT-4-Turbo-1106gpt-4-1106-preview
OpenAI GPT-35-Turbo-0125gpt-35-turbo-0125
Meta Llama 3 8Bllama3-8b-8192
Meta Llama 3 70Bllama3-70b-8192
Mixtral 8x7B SMoEmixtral-8x7b-32768
Google Gemma 7Bgemma-7b-it
Google Gemma 2 9Bgemma2-9b-it

If you need a model that you can't find it in the table above, send us a request here.