Re: Curious about max_tokens limits

[gitanon112]

Hey,

Thanks a lot for this! Great work!! Was just curious about

class MessagesRequest(BaseModel):
    model: str
    messages: List[Message]
    max_tokens: Optional[int] = 1024
    temperature: Optional[float] = 0.7
    stream: Optional[bool] = False
    tools: Optional[List[Tool]] = None
    tool_choice: Optional[Union[str, Dict[str, str]]] = "auto"

Any reason behind why max_tokens=1024(instead of potential max 16384) and temperature=0.7 instead of 0.6? Will try it myself anyway, thanks!