Enhance OpenAI integration for better performance

[coderabbitai]

Objective

Improve the OpenAI integration to enhance response quality and reduce costs.

Tasks

• Update OpenAI client from v0.28.0 to the latest version
• Implement streaming responses for better user experience
• Add caching for similar queries to reduce API costs
• Implement retry logic for API failures
• Add better error handling for rate limits and token limits
• Fine-tune prompts for each pill mode based on testing feedback

Why this is important

As SocrAI's core functionality relies on OpenAI, optimizing this integration is crucial for performance and cost-efficiency.

References

• This issue was created from PR: impro #6