History

Woosuk Kwon 211318d44a Add throughput benchmarking script (#133 )		2023-05-28 03:20:05 -07:00
..
benchmark_latency.py	Add throughput benchmarking script (#133 )	2023-05-28 03:20:05 -07:00
benchmark_text_completion.py	Add throughput benchmarking script (#133 )	2023-05-28 03:20:05 -07:00
benchmark_throughput.py	Add throughput benchmarking script (#133 )	2023-05-28 03:20:05 -07:00
README.md	Add throughput benchmarking script (#133 )	2023-05-28 03:20:05 -07:00
trace.py	Add throughput benchmarking script (#133 )	2023-05-28 03:20:05 -07:00

Benchmarking CacheFlow

Downloading the ShareGPT dataset

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json