Announcing Anthropic Claude Support! π
Zep v0.10.0, released today, supports Anthropic's Claude family of LLMs for summarization and extraction tasks.
Anthropic's Claude family of LLMs offers companies a safer and very capable alternative to other LLM-as-a-Service vendors. Claude's massive 100K token window is ideal for Zep's summarization and language extraction tasks. Support for the claude-2 and claude-instant-1 models is now available in Zep v0.10.0.
Configuring Zep to use Claude
Modify your config.yaml file, setting llm.service to anthropic and llm.model to either claude-2 or claude-instant-1.
Please see Zep's config documentation for more details, including how to use environment variables to do the above.
OpenAI Model Updates
Zep now also supports several new OpenAI model variants. The full list of models may be found below. See the Zep's config documentation for details on how to configure these.
| Provider | Model |
|---|---|
| OpenAI | gpt-3.5-turbo |
| OpenAI | gpt-3.5-turbo-16k |
| OpenAI | gpt-4 |
| OpenAI | gpt-4-32k |
| Anthropic | claude-instant-1 |
| Anthropic | claude-2 |
Zep Server v0.10.0 Improvements and Bug Fixes
Zep includes the following improvements and bug fixes:
- OpenAI API call reliability: API throttling and service availability issues can be problematic for production services. Zep now has improved support for HTTP 429 and 503
Retry-Afterdirectives. - Session Deletion Behavior Change: Persisting memory to a soft-deleted session no longer results in an error. Doing so will now undelete the
Session, but keep the previously deletedMemorymessages soft-deleted. These messages will be hard deleted when a subsequent Purge task runs.
Additional details on minor bug fixes and improvements may be found in the v0.10.0 Release Notes.