irotem98
/

fast-code-pruner

Token Classification

context-pruning

Model card Files Files and versions

irotem98 commited on Aug 11

Commit

ed292d7

·

verified ·

1 Parent(s): 11544fb

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -71,7 +71,7 @@ automatically.
 | Model | Backend | Concurrency 1 ↑ | Concurrency 16 ↑ |
 |---|---|---:|---:|
-| **fast-code-pruner** | vLLM 0.13.0 | **79.0 req/s** | **143.4 req/s** |
 | fast-code-pruner | Hugging Face | 16.01 req/s | 16.03 req/s |
 | code-pruner | Hugging Face | 9.83 req/s | 10.03 req/s |

 | Model | Backend | Concurrency 1 ↑ | Concurrency 16 ↑ |
 |---|---|---:|---:|
+| **fast-code-pruner** | vLLM 0.27.0 | **85.0 req/s** | **214.4 req/s** |
 | fast-code-pruner | Hugging Face | 16.01 req/s | 16.03 req/s |
 | code-pruner | Hugging Face | 9.83 req/s | 10.03 req/s |