-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Description
Hi, @fatih-ilhan !
I notice that there is a file named 'test.tsv' when loading the SST2 test set.
And the original version in SST2 test set 's labels are -1.
As your code , it needs to be relabeled.
Could you please sent me a copy of this file?
test_df = pd.read_csv('datasets/sst2/test.tsv', header=None, sep='\t')
synch_list = [test_set['sentence'].index(s.lower().replace('-lrb-', '(').replace('-rrb-', ')'))
for s in test_df.iloc[:, 0].tolist()]
synch_list = [synch_list.index(i) for i in range(len(synch_list))]
new_labels = [test_df.iloc[:, -1].tolist()[x] for x in synch_list]
def change_label(data, idx):
data['label'] = new_labels[idx]
return data
test_set = test_set.map(change_label, with_indices=True)
Metadata
Metadata
Assignees
Labels
No labels