๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ
์ˆจํ„ฐ ๊ฐ€๋ณ๊ฒŒ ์ฝ๋Š” ๊ณต๊ฐ„
์ด๋ฏธ์ง€ ์ฐจ๋‹จ
์ „์ฒด ๋ฒ ์ŠคํŠธ ์ตœ๊ทผ
โ† thesingularity ๊ฒŒ์‹œํŒ

[๐Ÿ“ช์ •๋ณด] ๊ตฌ๊ธ€์˜ 5400์–ต ํŒŒ๋ผ๋ฏธํ„ฐ Pathways language model

ํŠน๊ฐค์šฉ(singularity45) 2022-04-05 02:03 ์ถ”์ฒœ 107

24b0d121e08a76a167b9f68b12d21a1dc688cf23ba3009

https://ai.googleblog.com/2022/04/pathways-language-model-palm-scaling-to.html?m=1


1ebec223e0dc2bae61ab84e54483696d2d9a232d1cf56c9f8af5eca6d35244bac36ff460c3a94b948f22716d

BIG-bench (https://github.com/google/BIG-bench)์—์„œ Human average ์ดˆ๊ณผ


0fb4d704e0dc3bae5dafd3b123c1072f8c2e5d8a19d6c2962bba26e245ed30764bbb76af7e3f

1ebec223e0dc2bae61ab84e54483696d2d9a232d1cf56d9e8af4efa6d35244ba35e10d994069d614b2b036ef46

24b0d121e08776b660b8f68b12d21a1da3c62585fa5f

0eb2d42febd51dbe6fb2c6b913c2326f23fedd5eb9b768d047aff67deccd86b4c95ed4821ba8a6

29b8d536e3db20997abec5be29897364086ee634edf91497fbfbcaba5459c202

๋Œ“๊ธ€ 52

  • ๊ฐœ์ถ” ๋ˆŒ๋Ÿฌ ๋ฏธ์นœ๋…„๋“ค์•„!!!!!!!!!

    ์ต๋ช…(220.117) 2022-04-05 02:06
  • ๋‹ต๊ธ€ dccon
    ์ต๋ช…(1.239) 2022-04-05 03:43
  • ์”จ๋ฐœ ํŠน์ด์  ์™”๋ƒ?

    ์ต๋ช…(118.38) 2022-04-05 02:10
  • ์˜ค - dc App

    ์ต๋ช…(14.55) 2022-04-05 02:12
  • dccon
    ์ต๋ช…(121.183) 2022-04-05 02:14
  • ๊ฐœ์ถ” ๋ˆŒ๋Ÿฟ๋Š”๋ฐ ํ•ด์„์ข€

    ์ต๋ช…(218.52) 2022-04-05 02:14
  • ์—ฌ๋Ÿฌ๋ถ„์•ผ์—์„œ ์ธ๊ฐ„ ํ‰๊ท ์„ ๋„˜์—ˆ๋‹ค๋Š”๊ฒŒ ๊ด„๋ชฉํ• ๋งŒํ•˜๋„ค

    ์ต๋ช…(125.180) 2022-04-05 02:15
  • ๊ตญํ‰์˜ค๋ฅผ ๋›ฐ์–ด๋„˜์—ˆ๋…ธ ใ…‹ใ…‹

    ์ต๋ช…(39.117) 2022-04-05 02:16
  • ๋‹ต๊ธ€

    ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹

    ์ต๋ช…(112.144) 2022-04-05 05:53
  • ์•„์ง ๋ฉ€์—ˆ์Œ. ์ธ๊ฐ„ ์ „๋ฌธ๊ฐ€ ์ˆ˜์ค€๊นŒ์ง€ ๋›ฐ์–ด๋„˜์–ด์•ผ ํ•œ๋‹ค!!!!! - dc App

    ์ต๋ช…(27.119) 2022-04-05 02:17
  • ํŒŒ๋ผ๋ฏธํ„ฐ๋งŒ ๊ฐ€์ง€๊ณ  ๋˜๋Š”๊ฒŒ์•„๋‹ˆ๋‹ค ใ…‹ใ…‹ใ…‹ใ…‹๊ทธ๋žฌ์œผ๋ฉด ๊ณผํ•™์ž๋“ค์ด ๋งŒ์žฅ์ผ์น˜๋กœ ๊ณง ํŠน์ด์ ์˜จ๋‹ค๊ณ ํ•˜์ง€

    ์ต๋ช…(121.167) 2022-04-05 02:26
  • ๋‹ต๊ธ€ dccon
    StarLordโ„ข(dwks4499) 2022-04-05 07:17
  • ๋‹ต๊ธ€

    ๋ชฐ๋ผ์„œ ๊ทธ๋Ÿฐ๋ฐ ๋ญ๊ฐ€ ๋” ํ•„์š”ํ•จ? - dc App

    ใ…ใ…‡(220.127) 2022-04-05 19:52
  • ์นœ์น ๋ผ ์ตœ๋‹จํ‡ด์ƒˆ๋ผ ใ…‹ใ…‹

    ์ต๋ช…(211.225) 2022-04-05 02:27
  • ๋‹ต๊ธ€

    ์นœ์น ๋ผ2๋„ ๋“ฑ์žฅํ•˜์‹ค ๊ฒƒ์ด๋‹ค!!!!!!!!! ๊ฒฝ์Ÿํ•ด์•ผ ํŠน์ด์  ๋” ๋นจ๋ฆฌ์™€!!!! - dc App

    ์ต๋ช…(27.119) 2022-04-05 02:36
  • ์™”๋‚˜?

    ์ต๋ช…(222.96) 2022-04-05 02:38
  • ๋‹ต๊ธ€

    ์•„์ง ๋ฉ€์—ˆ๋‹ค!!! ์ธ๊ฐ„ ์ „๋ฌธ๊ฐ€๋ฅผ ๋›ฐ์–ด๋„˜์–ด์•ผ ๊ทธ๊ฒƒ์ด ์ง„์ •ํ•œ agi์˜ ๋„๋ž˜์ธ ๊ฒƒ์ด๋‹ค!!!!! - dc App

    ์ต๋ช…(27.119) 2022-04-05 02:40
  • 2025agi 2035ํŠน์ด์ ์ด ์ง„์งœ ํ˜„์‹ค์ธ๋“ฏ ใ„ทใ„ท

    ์ต๋ช…(211.55) 2022-04-05 02:53
  • dccon
    ์ต๋ช…(1.239) 2022-04-05 03:07
  • dccon
    ์ต๋ช…(121.188) 2022-04-05 03:08
  • ใ……ใ…‚

    ์ต๋ช…(218.235) 2022-04-05 03:23
  • dccon
    ์ต๋ช…(27.35) 2022-04-05 03:42
  • ์„น์Šค

    ์ต๋ช…(8pgrhrjb2194) 2022-04-05 03:50
  • ์–ด??? 2025 agi ๋ฐ˜๋†๋‹ด์œผ๋กœ ํ•˜๋Š” ์ด์•ผ๊ธฐ์˜€๋Š”๋ฐ ์ด๊ฑธ... - dc App

    ์ต๋ช…(14.50) 2022-04-05 04:03
  • ๋‹ต๊ธ€ dccon
    ์ต๋ช…(27.119) 2022-04-05 04:07
  • ๋‹ต๊ธ€

    ใ……ใ…‚

    ์ต๋ช…(218.235) 2022-04-05 04:09
  • ์ง„์งœ ์ธ๊ณต์ง€๋Šฅ์ด ํ•ด๋‚ธ๋‹ค ์•„ ์ฉ๋‹ค

    ํ…Œ์Šฌ๋žŒ(lex0234) 2022-04-05 04:08
  • ์—ญ์’ธ ๊ตฌ๊ธ€ ์•„์ฃผ ์ ์€ ํŒจ๋ผ๋ฏธํ„ฐ๋กœ ์ด๋ฃฉํ–ˆ๋„คใ…Žใ„ทใ„ท 2025๋…„๊นŒ์ง€ agi๋„ ๊ตฌ๊ธ€๋‹˜์ด ํ•ด์ค„๊ฑฐ๋ผ๊ณ  ๋ฏฟ๋Š”๋‹ค^^b

    ์ต๋ช…(amazonia) 2022-04-05 04:16
  • ์„ ํ˜•์ถฉ๋“ค ๊ฐœ๊ฐ™์ด ๋ฉธ๋ง ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ใ…‹ ๊ตฌ๊ธ€์€ ์‹ ์ด๋‹ค

    ์ต๋ช…(49.165) 2022-04-05 04:36
  • dccon
    ใ…‡ใ…‡ใ…‡(14.38) 2022-04-05 06:26
  • ํœด๋จผ ๋ฒ ์ŠคํŠธ ์ˆ˜์ค€ ๋„˜๊ธฐ๊ณ  ์Œ์„ฑ ์ž…์ถœ๋ ฅ์ด๋ž‘ ์—ฐ๊ณ„๋งŒ ํ•˜๋ฉดใ…‹ใ…‹์ง์—… ๋งŽ์ด ์—†์–ด์ง€๊ฒ ๋Š”๋ฐ?? ๋ฐœ์ „ ๊ฐœ๋น ๋ฅด๋…ธใ…‹ใ…‹ใ…‹

    ์ต๋ช…(121.131) 2022-04-05 07:20
  • ์™”๋‹ค

    ์ต๋ช…(125.191) 2022-04-05 07:39
  • dccon
    ๋ ˆ๋ชฌ์ƒค๋ฒ ํŠธ(yabu1020) 2022-04-05 08:27
  • dccon
    ์ต๋ช…(124.5) 2022-04-05 08:43
  • From these results, we can draw a number of conclusions. First, the results presented here suggest that the improvements from scale for few-shot language understanding have not yet plateaued.

    ์ต๋ช…(1.239) 2022-04-05 09:27
  • ๋‹ต๊ธ€

    When we compare results from PaLM 540B to our own identically trained 62B and 8B model variants, improvements are typically log-linear.

    ์ต๋ช…(1.239) 2022-04-05 09:30
  • ๋‹ต๊ธ€

    This alone suggests that we have not yet reached the apex point of the scaling curve.

    ์ต๋ช…(1.239) 2022-04-05 09:31
  • ๋‹ต๊ธ€

    However, on a number of benchmarks, improvements are actually discontinuous, meaning that the improvements from 8B to 62B are very modest, but then jump immensely when scaling to 540B.

    ์ต๋ช…(1.239) 2022-04-05 09:31
  • ๋‹ต๊ธ€

    This suggests that certain capabilities of language models only emerge when trained at sufficient scale, and there are additional capabilities that could emerge from future generations of models.

    ์ต๋ช…(1.239) 2022-04-05 09:32
  • ๋‹ต๊ธ€

    ์™•์ฐฝ ๋Š˜๋ฆฌ์ž! ์–ด๋–ค ์ƒˆ๋กœ์šด๊ฒŒ ํŠ€์–ด๋‚˜์˜ฌ์ง€ ๋ชจ๋ฅด๋‹ˆ๊นŒ

    ์ต๋ช…(amazonia) 2022-04-05 10:01
  • ๊ทผ๋ฐ ๊ณ ํผ ์นœ์น ๋ผ์—์„œ ์ด๋ฏธ mmlu๋Š” ๊ตญํ‰์˜ค ์•„๋“ํ•˜๊ฒŒ ๋›ฐ์–ด๋„˜์€๊ฑฐ ์•„๋‹˜?? ๊ทผ๋ฐ ์—ฌ๊ธฐ์„  ์™œ ๋” ๋ฐœ์ „๋œ ๋ชจ๋ธ์ด ๊ตญํ‰์˜ค ๋›ฐ์–ด๋„˜๋Š”๊ฑธ๋กœ ๋‚˜์˜ค๋ƒ

    ์ต๋ช…(211.252) 2022-04-05 10:31
  • ํœด๋จผ๋ฒ ์ŠคํŠธ๊นŒ์ง€ ๋„ˆ๋ฌด ๋งŽ์ด ๋‚จ์€๊ฒŒ ์•„์‰ฝ๋„ค

    ์ต๋ช…(211.252) 2022-04-05 11:14
  • ์•„์•„ใ…ใ…์•„์•„์•„ใ…์•„ใ…์•„์•„์•„ใ…์•„

    ์ต๋ช…(175.115) 2022-04-05 11:33
  • ์‘๊ธฐ์ž‡!!!! ์˜จ๋‹ค์•„์•„์•„์•™์•—!!!!!!

    ใ…ใ„ดใ…‡ใ„น(125.132) 2022-04-05 11:43
  • ํฌ... - dc App

    ๋ ˆ์ด์ปค์ฆˆ์™€์ผ(raykurzweil) 2022-04-05 13:35
  • ์ถ”์ฒœ ์™ค์ผ€ ๋งŽ์ง€ - dc App

    ์„ธ์ž…์••(saber6939) 2022-04-05 18:50
  • dccon
    ์ต๋ช…(hyeongim264) 2022-04-05 23:06
  • ํŠน์ด์ ์€ ์˜จ๋‹ค

    ์œ ํฌ์ƒํ™œ๊ฐ์„ฑ(ejdejdwns) 2022-04-05 23:08
  • ๋‹ต๊ธ€

    ๊ทธ๋ฆฌ๊ณ  "๋‚˜๋Š” ์œ ํฌ์ƒํ™œ์„ ๊ฐ์„ฑํ•œ๋‹ค"

    ์œ ํฌ์ƒํ™œ๊ฐ์„ฑ(ejdejdwns) 2022-04-05 23:08
  • ํ‚น๊ฐ“๊ตฌ๊ธ€ํ™ฉ๋‹˜ ๋ฏฟ์Šต๋‹ˆ๋‹ค !!!!!!!!!!!!

    ์ต๋ช…(182.218) 2022-04-06 01:30
  • dccon
    ์ต๋ช…(nhw0924) 2022-04-06 04:33
  • ์•ˆ๊ฐ„ ํ•˜๋‰˜ 10ํ”„๋กœ์ •๋„๋Š” ์ด๋ฏธ ๋›ฐ์–ด๋„˜์—ˆ๊ฒ ๋Š”๋ฐ

    ์ต๋ช…(110.12) 2022-04-06 16:01

๋‹ค๋ฅธ ๊ฒŒ์‹œ๊ธ€

  • ์œ ๋ฐœ ํ•˜๋ผ๋ฆฌ 2020 ๋‹ค๋ณด์Šค ํฌ๋Ÿผ ์—ฐ์„ค [4]
    [์ผ๋ฐ˜] ์ต๋ช…(119.196) | 22.04.05
    ์ถ”์ฒœ 8
  • ํŠน์ด์ ์˜ค๋ฉด ์ด์ •๋„ ํ•จ์„ ๋งŒ๋“ค์ˆ˜์žˆ๋ƒ? [2]
    [์ผ๋ฐ˜] ์ต๋ช…(222.239) | 22.04.05
    ์ถ”์ฒœ 1
  • ์ „์„ธ๊ณ„ ์ƒ์œ„ 10% [13]
    [์ผ๋ฐ˜] ์ต๋ช…(121.183) | 22.04.05
    ์ถ”์ฒœ 2
  • ์ผ๋ก ๋จธ์Šคํฌ ํŠธ์œ„ํ„ฐ๋„ ๊ฐ€์ ธ๋ฒ„๋ ธ๋…ธ [1]
    [์ผ๋ฐ˜] ์ต๋ช…(210.123) | 22.04.05
    ์ถ”์ฒœ 0
  • ์—ญ๋…ธํ™”๊ฐ€ ์‹คํ˜„๋˜๋ฉด ์ธ๊ตฌ์กฐ์ ˆ์€ ์–ด์ผ€ํ•ด? [12]
    [์ผ๋ฐ˜] ์ต๋ช…(115.21) | 22.04.05
    ์ถ”์ฒœ 0
  • ์ด์„ธ๊ณ„๋Š” ๊ฐ€์ƒ์„ธ๊ณ„ ์ง„์งœ์„ธ๊ณ„๋Š” ๋ฌดํ•œํ•œ๋ฆฌ์†Œ์Šค์„ธ์ƒ์ž„ [1]
    [์ผ๋ฐ˜] ์ต๋ช…(220.85) | 22.04.04
    ์ถ”์ฒœ 1
  • ๋ง‰์ƒ ์—ญ๋…ธํ™”๊ธฐ์ˆ  ๋‚˜์˜ค๋ฉด ์œค๋ฆฌ์ถฉ๋“ค ์ž…์‹น๋‹ซ๊ณ  ์‹œ์ˆ ๋ฐ›์Œ [3]
    [์ผ๋ฐ˜] ์ต๋ช…(121.147) | 22.04.04
    ์ถ”์ฒœ 1
  • ์ด์„ธ์ƒ์ด ๊ฐ€์ƒ์„ธ์ƒ์ด๋ฉด ์ง„์งœํ˜„์‹ค์— ๋„๋‹ฌํ•˜๋ ค๋ฉดใ„ทใ„ท [1]
    [์ผ๋ฐ˜] ์ต๋ช…(220.117) | 22.04.04
    ์ถ”์ฒœ 1
  • ใ„นใ…‡๊ทผ๋ฐ ๋…ธํ™” ๊ด€๋ จ์œผ๋ก  ์ธ์‹๋Œ€๊ฐœ๋ณ€ ํ•„์š”ํ•˜๊ธด ํ• ๋“ฏ [2]
    [์ผ๋ฐ˜] ์ต๋ช…(210.183) | 22.04.04
    ์ถ”์ฒœ 3
  • ์–‘์ž์–ฝํž˜์ด ๋น›๋ณด๋‹ค ๋น ๋ฅด๊ฒŒ ์ •๋ณด๋ฅผ ์ „๋‹ฌํ• ์ˆ˜์žˆ๋Š”๊ฑด ์•„๋‹˜ [3]
    [์ผ๋ฐ˜] ์ต๋ช…(210.123) | 22.04.04
    ์ถ”์ฒœ 0
๋ชฉ๋ก์œผ๋กœ
์ฝ๊ธฐ ์ „์šฉ ๋ฏธ๋Ÿฌ