← thesingularity 게시판

[일반] llama에 lora를 사용해 100k까지 파인튜닝

프로딩(cjm1105) 2023-09-25 18:09 추천 4

https://github.com/dvlab-research/LongLoRA

GitHub - dvlab-research/LongLoRA: Efficient long-context fine-tuning, supervised fine-tuning, LongQA dataset.Efficient long-context fine-tuning, supervised fine-tuning, LongQA dataset. - GitHub - dvlab-research/LongLoRA: Efficient long-context fine-tuning, supervised fine-tuning, LongQA dataset.github.com

llama2 70b을 32k로 늘리는 것에 8개의 A100을 사용함

- dc official App

댓글 1

익명(rechido) 2023-09-25 21:01