squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

Update README.md to add megablocks requirement for mixtral (#2033)

Browse Source
This commit is contained in:
Ram 2023-12-12 01:07:34 +05:30 committed by GitHub
parent 81ce2a4b26
commit 2eaa81b236
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -72,6 +72,10 @@ Install vLLM with pip or [from source](https://vllm.readthedocs.io/en/latest/get
```bash ```bash
pip install vllm pip install vllm
``` ```
**NOTE:** The Mixtral model additionally requires `megablocks` which can be installed with pip or [from source](https://github.com/stanford-futuredata/megablocks) on **Python 3.10**:
```bash
pip install megablocks
```
## Getting Started ## Getting Started