Prompt too long error

Data Modeling
1

We haven’t made any changes to our deployment on promptql but we started seeing this error come up today. Should we change the LLM being used? Why is the context smaller now? It worked yesterday?

Error calling Anthropic: Error code: 400 - {'type': 'error', 'error': {'type': 'invalid_request_error', 'message': 'prompt is too long: 203223 tokens > 200000 maximum'}}
2

Hiya, @ma2ran — there’s a few possible answers:

  1. There was an issue with Anthropic today as you can see from their historical data on the status page.
  2. While the metadata may not have changed, is there a greater amount of data included in your DB? It’s possible the additional context—depending on the operation—is causing you to spill over the context limits.