Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
90acec9
add dlrm benchnark files
ShawnXuan Jul 28, 2022
1ae2602
modify sh
ShawnXuan Jul 28, 2022
5e0b69a
add dcn benchmark files
ShawnXuan Jul 28, 2022
803cc82
add deepfm benchmark files
ShawnXuan Jul 28, 2022
a86382c
modify dlrm scripts
ShawnXuan Aug 3, 2022
e00436a
script ready
ShawnXuan Aug 4, 2022
9c015dd
make raw dataset
ShawnXuan Aug 4, 2022
fbcbc6e
update dlrm readme
ShawnXuan Aug 5, 2022
8200172
update scala files
ShawnXuan Aug 5, 2022
e1afb77
Merge branch 'main' of github.com:Oneflow-Inc/models into ctr_benchma…
ShawnXuan Aug 5, 2022
ab019bc
update
ShawnXuan Aug 5, 2022
7f3a231
update
ShawnXuan Aug 5, 2022
62d3047
update dcn benchmark scripts
ShawnXuan Aug 5, 2022
1a65042
update deepfm benchmark scripts
ShawnXuan Aug 5, 2022
0eed35c
deepfm working
ShawnXuan Aug 5, 2022
4e567c3
deepfm update
ShawnXuan Aug 5, 2022
2c9760a
keep deepfm dcn only
ShawnXuan Aug 8, 2022
b4492e8
Merge branch 'main' of github.com:Oneflow-Inc/models into ctr_benchma…
ShawnXuan Aug 8, 2022
949840b
update deepfm benchmark scripts
ShawnXuan Aug 8, 2022
794d505
update dcn benchmark scripts
ShawnXuan Aug 8, 2022
c1c93ee
make criteo1t dataset 39 catigorical fields
ShawnXuan Aug 8, 2022
33a4fbd
parquet to raw C39
ShawnXuan Aug 8, 2022
e25d7ce
update readme
ShawnXuan Aug 8, 2022
2cc1d81
fix link
ShawnXuan Aug 8, 2022
644e683
fix
ShawnXuan Aug 8, 2022
205fe55
rm dlrm files
ShawnXuan Aug 8, 2022
5463a11
restore dlrm changes
ShawnXuan Aug 8, 2022
7d7ccb3
restore dlrm files
ShawnXuan Aug 8, 2022
ae88c01
fix deepfm scala
ShawnXuan Aug 9, 2022
f833c1e
update
ShawnXuan Aug 10, 2022
e92f49f
rm usless lines
ShawnXuan Aug 30, 2022
4cf9bac
update
ShawnXuan Aug 30, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 15 additions & 0 deletions RecommenderSystems/dcn/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -161,6 +161,21 @@ You could modified it in [train.sh](https://github.com/Oneflow-Inc/models/blob/c
bash train.sh
`

## Run OneFlow DeepFM benchmark
Note: DCN benchmark uses the same dataset as DeepFM. Please follow the dataset preparing instruction in DeepFM [README](../deepfm#run-oneflow-deepfm-benchmark).
1. train OneFlow DeepFM benchmark in AMP mode
```
./train_dcn_benchmark.sh /path/to/data_dir
```
note: `train_dcn_benchmark.sh` takes 3 arguments:
- $1 is data_dir pointing to criteo1t_oneflow_raw dataset
- $2 is number of GPUs, default is `8`
- $3 is to enable oneflow raw reader direct io or not, default is `0`, set `1` to enable direct io

2. or train OneFlow DeepFM benchmark in FP32 mode

```
./train_dcn_benchmark_fp32.sh /path/to/data_dir
```


Loading