Commit Graph

Select branches

Hide Pull Requests

main

Mono Color

• ba84b8728a Fix attention Woosuk Kwon 2023-02-23 22:29:46 +0000
• 87e0bcd426 Fix attention Woosuk Kwon 2023-02-23 21:32:02 +0000
• 1ce1333573 Set default dtype to half Woosuk Kwon 2023-02-23 21:31:39 +0000
• de0fabbc5c Fix sampler Woosuk Kwon 2023-02-23 20:30:12 +0000
• fdd0f2f472 Minor Woosuk Kwon 2023-02-23 20:23:47 +0000
• 7f985166f7 Consider pempty tensor Woosuk Kwon 2023-02-23 20:20:33 +0000
• 86f9eb6d39 Fix typo Woosuk Kwon 2023-02-23 20:19:24 +0000
• 1f6c7ef437 Add controller Woosuk Kwon 2023-02-23 09:32:19 +0000
• d4bc1a4d24 Add unoptimized OPT Attention Woosuk Kwon 2023-02-23 09:31:55 +0000
• b56b6ca0d6 Add greedy sampler Woosuk Kwon 2023-02-23 09:26:09 +0000
• 343cea3dbc Add seq_ids to input metadata Woosuk Kwon 2023-02-23 09:25:01 +0000
• 4f6f4967f6 Add get_block_table Woosuk Kwon 2023-02-23 07:55:14 +0000
• 331fa0b042 Implement scheduler.step & Add a threshold for batch size Woosuk Kwon 2023-02-23 07:54:20 +0000
• 501c4bd0cd decoding.py -> sampling_params.py Woosuk Kwon 2023-02-23 07:39:20 +0000
• 86c682cd32 DecodingParams -> SamplingParams Woosuk Kwon 2023-02-23 07:38:43 +0000
• af16c05074 Add get_len Woosuk Kwon 2023-02-23 05:58:04 +0000
• d094512296 Move max_context_len Woosuk Kwon 2023-02-23 04:57:46 +0000
• 4b1ac23f53 Fix slot mapping Woosuk Kwon 2023-02-23 00:10:07 +0000
• 8290fce47d Add Worker class Woosuk Kwon 2023-02-22 19:01:38 +0000
• 7b6844e590 Add input metadata Woosuk Kwon 2023-02-22 19:01:20 +0000
• 608f74ffe5 Minor Woosuk Kwon 2023-02-22 18:08:25 +0000
• 709a69176e Move worker/models -> models Woosuk Kwon 2023-02-22 18:03:48 +0000
• af68ec1c5c Add tests for kernels Woosuk Kwon 2023-02-18 19:23:07 +0000
• c413c41cda Add reshape_and_cache op Woosuk Kwon 2023-02-18 19:22:57 +0000
• ffad4e1e03 cache_kernel -> cache_kernels Woosuk Kwon 2023-02-16 20:05:45 +0000
• 6d2f74efb3 Remove redundant fn Woosuk Kwon 2023-02-16 09:24:42 +0000
• 3b41f16596 Add gitignore Woosuk Kwon 2023-02-16 07:47:21 +0000
• 6f058c7ba8 Implement cache ops Woosuk Kwon 2023-02-16 07:47:03 +0000
• a1c67e6db8 Minor Woosuk Kwon 2023-02-16 01:42:53 +0000
• 9e68a6827e Fix return type error Woosuk Kwon 2023-02-16 01:33:03 +0000
• 8edcabc737 Add warning Woosuk Kwon 2023-02-16 01:28:17 +0000
• 2f4887de77 Fix KVCache shape Woosuk Kwon 2023-02-16 01:24:45 +0000
• 3363c27d19 Add __repr__ Woosuk Kwon 2023-02-14 09:34:07 +0000
• 2729087efe Fix a ref count bug in swapping Woosuk Kwon 2023-02-14 09:20:12 +0000
• c128c2ed03 Fix double free Woosuk Kwon 2023-02-14 09:14:05 +0000
• c80ed212a1 Minor Woosuk Kwon 2023-02-14 09:06:27 +0000
• 263e91b386 Minor Woosuk Kwon 2023-02-14 09:05:39 +0000
• be1e2163c9 Fix memory leak in swapping Woosuk Kwon 2023-02-14 08:45:59 +0000
• 7e5f604e68 Fix bugs in scheduler Woosuk Kwon 2023-02-14 02:25:32 +0000
• 1f739f9b03 Fix a bug in swap_in and swap_out Woosuk Kwon 2023-02-14 02:12:58 +0000
• b1644f764f Fix can_swap_in Woosuk Kwon 2023-02-14 01:57:40 +0000
• c574f19506 Fix typo Woosuk Kwon 2023-02-14 01:19:27 +0000
• e40fa136aa Fix typo Woosuk Kwon 2023-02-14 01:19:05 +0000
• ee9442518d Fix get_model Woosuk Kwon 2023-02-13 22:51:03 +0000
• 531e1c74e8 Fix typo Woosuk Kwon 2023-02-13 18:51:33 +0000
• d3d317665b Fix scheduler Woosuk Kwon 2023-02-13 09:37:00 +0000
• fffa2e1f4b Add model_utils Woosuk Kwon 2023-02-13 09:36:12 +0000
• bb59a3e730 Fix cache engine Woosuk Kwon 2023-02-13 09:35:48 +0000
• 5a309bb588 Add scheduler Woosuk Kwon 2023-02-13 02:39:53 +0000
• 0961f5a49a Add find method to sequence group Woosuk Kwon 2023-02-13 02:39:12 +0000
• eb52db1bea Fix can_swap_in Woosuk Kwon 2023-02-13 02:38:50 +0000
• a2a9869cb7 SERVING -> RUNNING Woosuk Kwon 2023-02-12 08:25:05 +0000
• 46958cf941 BlockAllocator -> BlockManager Woosuk Kwon 2023-02-12 08:15:18 +0000
• 3be29a1104 Add blank setup file Woosuk Kwon 2023-02-09 11:37:06 +0000
• 38ed06a846 Minor Woosuk Kwon 2023-02-09 11:30:55 +0000
• 0a11a2e5ca Add gitignore Woosuk Kwon 2023-02-09 11:28:12 +0000
• e7bee2aa81 Add cache engine Woosuk Kwon 2023-02-09 11:28:02 +0000
• aa78aeaa0f Add block manager Woosuk Kwon 2023-02-09 11:27:33 +0000
• 3c2b47fcae Add decoding params Woosuk Kwon 2023-02-09 11:27:06 +0000
• 5e644b912e Add utils Woosuk Kwon 2023-02-09 11:26:50 +0000
• d904350a2c Add sequence Woosuk Kwon 2023-02-09 11:26:35 +0000
• 6680129ba2 Add blocks Woosuk Kwon 2023-02-09 11:26:21 +0000
• 39161c98a0 Add OPT Woosuk Kwon 2023-02-09 11:25:37 +0000
• e7d9d9c08c Initial commit Woosuk Kwon 2023-02-09 11:24:15 +0000