-
Notifications
You must be signed in to change notification settings - Fork 33
Open
Description
Hi, I have a small question about MEND edit procedure in test time:
In your paper's Algorithm 2, line 7 (updating the weight matrix of layer mend.py, line 227,
updates = {n: lr * g for lr, (n, g) in zip(self.edit_lrs, mean_grads.items())},
there actually is learning rate when updating, right?
Thank you!
Metadata
Metadata
Assignees
Labels
No labels