Skip to content
This repository was archived by the owner on Aug 19, 2024. It is now read-only.

Comments

[DRAFT] Supermask Tensor#10

Draft
cpuhrsch wants to merge 10 commits intomainfrom
ts1
Draft

[DRAFT] Supermask Tensor#10
cpuhrsch wants to merge 10 commits intomainfrom
ts1

Conversation

@cpuhrsch
Copy link
Contributor

@cpuhrsch cpuhrsch commented Apr 11, 2024 •
edited
Loading 

benchmark.py --model vit_h_14 --batch-size 512 --bfloat16 --sparsity-linear 0.9 --sp-linear-tile-size 64 --sparsify-weights
> 1110.60640625ms 5571MB of RAM, 13% of RAM
--bsr 64
> 936.00875ms 4845MB of RAM, 11% of RAM
--use-ts
> 844.448671875ms 4466MB of RAM, 11% of RAM

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Apr 11, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@cpuhrsch @facebook-github-bot