A little background, this announcement comes out of Nividia's yearly GPU Technology Conference, so we can all expect to see additional news pieces coming out over the next hours and days.
This supercomputer is being used in part to demonstrate the capabilities of Nivida's line of commercially available supercomputers such as the DGX Pod and DGX Superpod, these are expensive AI supercomputers which are being marketed to wealthy corporations, government agencies, and the exorbitantly rich who can afford them for their private labs.
For context, when the more expensive version of the DGX line, The Superpod, was created it made the Top500 list for most powerful supercomputers, ranking 22nd at the time. Back in August, Nvidia created the 7th most powerful supercomputer, Selene using Superpods, probably in preparation for this, but that was all with the old A100's. This new design using H100's is much faster and clearly DESIGNED specifically for training large language models. This fact cannot be emphasized enough, even if 100T doesn't result in proto-AGI's or anything of that sort, it becomes increasingly clear that Nvida's plan seems to be mass producing models and using them to build the Metaverse. If Nvidia is even moderately successful in doing this, along with the other AI companies, it will result in an information explosion comparable to the birth of the internet, it would be an internet with constant autogenerated content, AI capable of, at minimum, speeding up the development of all media and code-based resources, video games, film, music videos, and proprietary software.
Something like this happening prior to recursive improvement is what we might call a soft takeoff in which progress greatly accelerates prior to the creation of true AGI/ASI but improves enough to begin increasingly changing the world around us for a relatively lengthy period (perhaps years) before culminating in the creation of more fully conscious systems.
A major emphasis of this conference has been the Omniverse (Nvidia's brand for the Metaverse). Since the Metaverse concept started picking up in business several months ago and Nvidia revealed several new developments at that time back in November. Nivida has been branding themselves as the provider of infrastructure for that omniverse, not only helping build the supercomputers they believe will power it, but also the "connective tissue".
For this reason it is no doubt, a major point of pride for Nvidia, to make heavy usage of their Quantum 2 Infiniti Band here, which in very simple terms, you could think of as extremely fast fiber optic cables which have been touted as being a major part of the future infrastructure for the metaverse...the fundamental idea here being that the future involves powerful AI supercomputers connected using cutting edge networks like this...a sort of new, more powerful version of the internet built using extremely fast connections which Nvidia would like to get contracted to lay the cable for.
Just one observation about compute, eventually all this compute will become accessible on a more consumer level based on how this stuff gets less expensive, so eventually we'll see speeds like 70 TB/per sec everywhere and it will change everything.
Analyses of the likes of Nvidia, Meta, Google, and OpenAI has not been taken seriously enough, these companies are poised to change the world. It becomes too easy to assume what they're doing is hype, but their intentions and opinions have been revealed, sometimes not so subtly through their actions and statements.
45추 받은 댓글이네
원문가져와 번역 기발 개좆기네
https://www.reddit.com/r/singularity/comments/tkb7q2/announcing_nvidia_eos_worlds_fastest_ai/
가서 봐라 이기야
요약좀
H100을 사용하는 이 새로운 디자인은 특히 대규모 언어 모델 교육을 위해 훨씬 빠르고 명확하게 설계 되었습니다. 이 사실은 아무리 강조해도 지나치지 않습니다. 100T가 proto-AGI나 이와 유사한 것을 만들지 않더라도 Nvida의 계획이 모델을 대량 생산하고 이를 사용하여 Metaverse를 구축하는 것으로 보이는 것이 점점 더 분명해집니다. Nvidia가 다른 AI 회사와 함께 이 작업을 어느 정도 성공적으로 수행한다면 인터넷의 탄생에 필적하는 정보 폭발을 초래할 것이며, 지속적으로 자동 생성된 콘텐츠가 있는 인터넷이 될 것입니다. AI는 최소한 속도를 낼 수 있습니다. 모든 미디어 및 코드 기반 리소스, 비디오 게임, 영화, 뮤직 비디오 및 독점 소프트웨어의 개발을 향상시킵니다.
진정한 AGI/ASI가 생성되기 전에 진행이 크게 가속화되지만 상대적으로 긴 기간(아마도 몇 년) 동안 주변 세상을 점점 더 변화시키기 시작할 만큼 충분히 개선 되는 부드러운 도약 이라고 부를 수 있습니다. 더 완전히 의식적인 시스템의 생성으로 정점에 도달하기 전에.
대충 세상이 바뀌기 시작할만한 변화의 시작이라고 예측중
암튼 긍정적인 결론이네 기분좋다
ㄳㄳ
H100은 시작일 뿐 매년 기하급수의 발전이 온다 !