Skip to content

AceGPT chat Context window is 1024 tokens? #13

Description

@yasserkh2

When using AceGPT-7B-chat and AceGPT-13B-chat models, an error occurred stating that the input must have less than 1024 tokens. The input provided had 1322 tokens. I want to clarify whether this error occurred because it was insufficient to produce just the first response. Additionally, I'm wondering if these models are designed for RAG (Retrieval-Augmented Generation) due to the context window?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions