Regression? examples/rl/workflows/simple_learner.py cannot run anymore🐛

[susanhuhu]

susan@vm-2:~/maro$ python ./examples/rl/workflows/simple_learner.py
Traceback (most recent call last):
File "./examples/rl/workflows/simple_learner.py", line 14, in
from agent_wrapper import get_agent_wrapper
File "/home/susan/maro/examples/rl/workflows/agent_wrapper.py", line 13, in
from general import agent2policy, non_rl_policy_func_index, rl_policy_func_index
File "/home/susan/maro/examples/rl/workflows/general.py", line 21, in
module = importlib.import_module(f"{config['scenario']}")
File "/usr/lib/python3.7/importlib/init.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "/home/susan/maro/examples/rl/supply_chain/init.py", line 4, in
from .env_wrapper import get_env_wrapper
File "/home/susan/maro/examples/rl/supply_chain/env_wrapper.py", line 1173, in
tmp_env_wrapper = get_env_wrapper(replay_agent_ids=[])
File "/home/susan/maro/examples/rl/supply_chain/env_wrapper.py", line 1170, in get_env_wrapper
return SCEnvWrapper(env=Env(**env_config), replay_agent_ids=replay_agent_ids)
File "/home/susan/maro/examples/rl/supply_chain/env_wrapper.py", line 85, in init
super().init(env, reward_eval_delay, replay_agent_ids=replay_agent_ids)
File "/home/susan/maro/maro/rl/learning/env_wrapper.py", line 69, in init
self._replay_buffer = {agent_id: defaultdict(list) for agent_id in replay_agent_ids}
File "/home/susan/maro/maro/rl/learning/env_wrapper.py", line 69, in
self._replay_buffer = {agent_id: defaultdict(list) for agent_id in replay_agent_ids}
TypeError: unhashable type: 'SkuInfo'

[ysqyang]

This issue has been fixed on an internal testing branch that has not been published to the repo yet. I will update this branch with the latest RL toolkit and the AKS scripts and publish it in the next few days. Thanks for your patience.