| .. |
|
DeepSeek-V2-Lite-Chat.yaml
|
[ Misc ] Apply MoE Refactor to Deepseekv2 To Support Fp8 (#6417)
|
2024-07-13 20:03:58 -07:00 |
|
Meta-Llama-3-8B-Instruct-Channelwise-compressed-tensors.yaml
|
[ Misc ] fbgemm checkpoints (#6559)
|
2024-07-20 09:36:57 -07:00 |
|
Meta-Llama-3-8B-Instruct-FBGEMM-nonuniform.yaml
|
[ Misc ] fbgemm checkpoints (#6559)
|
2024-07-20 09:36:57 -07:00 |
|
Meta-Llama-3-8B-Instruct-FP8-compressed-tensors.yaml
|
[Kernel] Turn off CUTLASS scaled_mm for Ada Lovelace (#6384)
|
2024-07-14 13:37:19 +00:00 |
|
Meta-Llama-3-8B-Instruct-FP8.yaml
|
[Kernel] Turn off CUTLASS scaled_mm for Ada Lovelace (#6384)
|
2024-07-14 13:37:19 +00:00 |
|
Meta-Llama-3-8B-Instruct-INT8-compressed-tensors.yaml
|
[ Misc ] Support Fp8 via llm-compressor (#6110)
|
2024-07-07 20:42:11 +00:00 |
|
Meta-Llama-3-8B-Instruct-nonuniform-compressed-tensors.yaml
|
[ Misc ] non-uniform quantization via compressed-tensors for Llama (#6515)
|
2024-07-18 22:39:18 -04:00 |
|
Meta-Llama-3-8B-Instruct.yaml
|
[ CI/Build ] LM Eval Harness Based CI Testing (#5838)
|
2024-06-29 13:04:30 -04:00 |
|
Meta-Llama-3-8B-QQQ.yaml
|
Support W4A8 quantization for vllm (#5218)
|
2024-07-31 07:55:21 -06:00 |
|
Meta-Llama-3-70B-Instruct-FBGEMM-nonuniform.yaml
|
[ Kernel ] Enable fp8-marlin for fbgemm-fp8 models (#6606)
|
2024-07-20 18:50:10 +00:00 |
|
Meta-Llama-3-70B-Instruct.yaml
|
[ CI/Build ] LM Eval Harness Based CI Testing (#5838)
|
2024-06-29 13:04:30 -04:00 |
|
Minitron-4B-Base.yaml
|
[Model] Support Nemotron models (Nemotron-3, Nemotron-4, Minitron) (#6611)
|
2024-07-26 14:33:42 -04:00 |
|
Mixtral-8x7B-Instruct-v0.1-FP8.yaml
|
[ Misc ] Refactor MoE to isolate Fp8 From Mixtral (#5970)
|
2024-07-02 21:54:35 +00:00 |
|
Mixtral-8x7B-Instruct-v0.1.yaml
|
[ CI/Build ] LM Eval Harness Based CI Testing (#5838)
|
2024-06-29 13:04:30 -04:00 |
|
Mixtral-8x22B-Instruct-v0.1-FP8-Dynamic.yaml
|
[ Misc ] Refactor MoE to isolate Fp8 From Mixtral (#5970)
|
2024-07-02 21:54:35 +00:00 |
|
models-large.txt
|
[ Kernel ] Enable fp8-marlin for fbgemm-fp8 models (#6606)
|
2024-07-20 18:50:10 +00:00 |
|
models-small.txt
|
Support W4A8 quantization for vllm (#5218)
|
2024-07-31 07:55:21 -06:00 |
|
Qwen2-1.5B-Instruct-FP8W8.yaml
|
[ Misc ] fp8-marlin channelwise via compressed-tensors (#6524)
|
2024-07-25 09:46:04 -07:00 |
|
Qwen2-1.5B-Instruct-INT8-compressed-tensors.yaml
|
[ Misc ] Support Models With Bias in compressed-tensors integration (#6356)
|
2024-07-12 11:11:29 -04:00 |
|
Qwen2-1.5B-Instruct-W8A16-compressed-tensors.yaml
|
[ Misc ] Support Models With Bias in compressed-tensors integration (#6356)
|
2024-07-12 11:11:29 -04:00 |
|
Qwen2-57B-A14-Instruct.yaml
|
[ Misc ] Refactor MoE to isolate Fp8 From Mixtral (#5970)
|
2024-07-02 21:54:35 +00:00 |
