Skip to content

compute_grpo_outcome_advantage 的疑问 #65

@gyy8426

Description

@gyy8426

如果我使用reward manager把attention mask对应的最后一个位置放上计算的score,然后在compute_grpo_outcome_advantage乘的是action mask不就没了么

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions