← sff 게시판

[일반] 4090 한대로 llama 13B 돌릴 수 있는 패키지 나왔네요

조약돌소리키보..(ux7kt1sxq6nh) 2023-03-10 11:15 추천 0

https://github.com/tloen/llama-int8

GitHub - tloen/llama-int8: Quantized inference code for LLaMA modelsQuantized inference code for LLaMA models. Contribute to tloen/llama-int8 development by creating an account on GitHub.github.com

ㄷㄷ

댓글 2

오

Jaygan(jaygan) 2023-03-10 11:48
와.. - dc App

BFox(terryou) 2023-03-10 12:11