Scenario when the commit is too big #1
Description
Error: error, status code: 429, message: Request too large for gpt-4o in organization org-SPUubLPcCAYBh6xQESfEkBEQ on tokens per min (TPM): Limit 30000, Requested 85761. The input or output tokens must be reduced in order to run successfully. Visit https://platform.openai.com/account/rate-limits to learn more.
Caused by the rate limit of openai. Find a way to handle this case, potential approach:
- Change to bigger model (not prefer)
- Split to multiple message to bypass the rate limit