Offline CQL performance on Hopper expert env

[pcheng2]

Hi, thank you for sharing the torch version code of CQL :)
I found as training on Hopper-expert-v2 env, CQL-SAC performs poorly.
Don't know why that happends.

Following are the relevant plots.

[BY571]

Hey, thank you for using the implementation and testing with it!
The results you get indeed look very bad. What hyperparameters did you use and did you try to change some?

[pcheng2]

@BY571 Hi, I was runing by the default parameters.
And yeah, I will try more parameters and hope it will work fine :p

[sohanglal]

https://github.com/orgs/community/discussions/109171
Frauds happening everywhere