[일반] ai의 치명적인 망각 완화에 대한 논문이 올라왔는데 무슨 말인지 모르겠다

[익명(black542)]

https://x.com/BerivanISIK/status/1825577160486302044

Super excited about new work Lottery Ticket Adaptation (LoTA): https://t.co/GMViXLtDqo

We propose a sparse adaptation method that finetunes only a sparse subset of the pre-trained weights. LoTA mitigates catastrophic forgetting and enables model merging by breaking the… https://t.co/cPHBxrUaQc pic.twitter.com/XGxquoISPp

— Berivan Isik (@BerivanISIK) August 19, 2024

현직자들 있으면 설명좀

[익명(vital7966)]

이건 continuous learning이 아님... catastrophic forgetting하곤 아무상관도 없음... model merge 쪽이라고 봐야함

[익명(d9nxlb7xxy5n)]

그닥