Supported LLMs

The command that will list all the models below is:

kg list-models

• OpenAI [default]

  Note

  The API key should be locally saved as an environment variable (`OPENAI_API_KEY`).

  • `kg-chat` uses `gpt-4o-mini` by default.

• Ollama:

  • For this you will have to download the Ollama application and run it on your machine.

  • Then get the model of your choice by running the following command in the terminal:

    ollama run llama3.1:405b
    

  Note

  The results are not very good with the 8b model. We recommend using the 405b model for decent results. GPU is recommended for faster results.

• Anthropic:

  • `kg-chat` uses `claude-3-5-sonnet-20240620` by default.

  Note

  The API key should be locally saved as an environment variable (`ANTHROPIC_API_KEY`).

• CBORG by LBNL:

  • `kg-chat` also supports models offered Lawrence Berkeley National Laboratory (via CBORG).

  • `kg-chat` uses `lbl/llama-3` by default which actually is llama3.1(405B).

  Note

  The API key should be locally saved as environment variable (`CBORG_API_KEY`).