Skip to content

Which hyper-parameters in the standard VERL configuration do not take effect? #464

@dalek-who

Description

@dalek-who

This is the full VERL config, https://verl.readthedocs.io/en/latest/examples/config.html
I noticed that some parameters seem not work when passed to agl.VERL. For example:

  • actor_rollout_ref.rollout.val_kwargs
  • data.truncation
  • actor_rollout_ref.rollout.top_p (I'm not sure if it takes effect, as it is not explicitly set like actor_rollout_ref.rollout.temperature)

self.agent_mode_daemon = self.daemon_cls(
self.config.agentlightning.port,
self.config.actor_rollout_ref.rollout.n,
train_information={
"model": model,
"temperature": self.config.actor_rollout_ref.rollout.temperature,
},

Could you provide a blacklist/whitelist to clarify which configs are effective or not?

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentationenhancementNew feature or requesthelp wantedExtra hands from community will be appreciated

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions