https://x.com/awnihannun/status/1783646659362332940?s=46&t=yxbtHaE70z0qjIgPqKlmeA
Run Apple's new OpenELM models in MLX LM thanks to @Prince_Canuma
— Awni Hannun (@awnihannun) April 25, 2024
pip install -U mlx-lm
270M model in 16-bit runs quite fast on an 8GB M2 Mini (512 tokens at 115 toks/sec). Also pretty good quality for the size: pic.twitter.com/M1baDrNYkX
관심 있는 사람은 깔아서 써보셈. 누가 쉽게 쓸 수 있게 올려노ㅓㅆ네
댓글 0