I’m worried about hitting API rate limits. What’s the best approach?
Connecting third party APIs to PromptQL can have issues arising from timeouts, rate limiting, or latencies due to limitations by the API vendor. To improve the PromptQL experience with such APIs, few things you can try:
- Add retry and backoff logic in the API fetch code.
- Consider bulk loading the API data into a database, like sqlite or duckdb. An example is documented at With Bulk API Data | Hasura PromptQL Docs