vllm/vllm/platforms/neuron.py
Mengqing Cao 9d827170a3
[Platforms] Add device_type in Platform (#10508)
Signed-off-by: MengqingCao <cmq0113@163.com>
2024-11-21 04:44:20 +00:00

11 lines
243 B
Python

from .interface import Platform, PlatformEnum
class NeuronPlatform(Platform):
_enum = PlatformEnum.NEURON
device_type: str = "neuron"
@classmethod
def get_device_name(cls, device_id: int = 0) -> str:
return "neuron"