์ข…ํ•ฉ ์ ์ˆ˜ o1๊ณผ 1์  ์ฐจ์ด๋กœ 2์œ„

๊ฐœ๋ณ„ ๋ฒค์น˜๋งˆํฌ์„œ 1~2์œ„ ๊ธฐ๋ก



<๊ฐ€์„ฑ๋น„ ๊ทธ๋ž˜ํ”„>



*Artificial Analysis๋Š” ๋‹น์‚ฌ ์‚ฌ์ดํŠธ์—์„œ ๋‹ค๋ฃจ๋Š” ๋ชจ๋“  ์–ธ์–ด ๋ชจ๋ธ ์—”๋“œํฌ์ธํŠธ์— ๋Œ€ํ•ด ๋…๋ฆฝ์ ์œผ๋กœ ํ’ˆ์งˆ ํ‰๊ฐ€๋ฅผ ์‹คํ–‰ํ•ฉ๋‹ˆ๋‹ค. ๋‹น์‚ฌ์˜ ํ˜„์žฌ ํ‰๊ฐ€ ์„ธํŠธ์—๋Š” MMLU, GPQA, MATH-500 ๋ฐ HumanEval์ด ํฌํ•จ๋ฉ๋‹ˆ๋‹ค. ๋‹ค๋ฅธ ์‚ฌ์šฉ ์‚ฌ๋ก€๋Š” ๋‹ค๋ฅธ ํ‰๊ฐ€ ํ…Œ์ŠคํŠธ๋ฅผ ๊ณ ๋ คํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.