Geoffrey Hinton now believes:


1) AIs are intelligent
2) AIs definitely understand
3) AIs now have some self-awareness (!)

현 AI는 자의식이 조금 있다
똑똑하다. 이해한다.

“We can't afford to get it wrong with these things... In 5 years time, AIs may well be able to reason better than us.”

5년뒤 우리보다 똑똑해질거다

"Humanity doesn’t know what it’s doing."

인류는 자기들이 뭘 하는지 몰라

“I think we're moving into a period when, for the first time ever, we may have things more intelligent than us.”

Q: You believe these AIs have experiences of their own and can make decisions based on those experiences in the same sense as people do?
A: Yes.

Q: And so human beings will be the second most intelligent beings on the planet?
A: Yeah.

Q: You think these AI systems are better at learning than the human mind?
A: I think they may be, yes.

곧 인간보다 똑똑한 존재를 볼거다

And at present, they're quite a lot smaller. So even the biggest chatbots only have about a trillion connections in them. The human brain has about 100 trillion. And yet, in the 1 trillion connections in a chatbot, it knows far more than you do in your 100 trillion connections, which suggests it's got a much better way of getting knowledge into those connections, a much better way of getting knowledge that isn't fully understood.

변수 1조개인데 저정도다 100조개면 어떻게됨?

Q: What do you mean? "We don't know exactly how it works?" It was designed by people.

Q) 근데 결국 저거 우리가 만든거 아닌가요?

A: No, it wasn't. What we did was we designed the learning algorithm. That's a bit like designing the principle of evolution.

But when this learning algorithm then interacts with data, it produces complicated neural networks that are good at doing things, but we don't really understand exactly how they do those things.

아니. 아니다. 우리가 만든건 그냥 학습 알고리즘이다
그러니까 우리는 진화 원리만 만든거다


그 알고리즘이 데이터와 상호작용하면서 복잡한 뉴럴 네트워크를 만들어낸다.... 그러니 우리는 그게 어떻게 작용하는지... 이해할수없게된다

Q: What are the implications of these systems autonomously writing their own computer code and executing their own computer code?
A: That's a serious worry. So one of the ways in which these systems might escape control is by writing their own computer code to modify themselves. And that's something we need to seriously worry about.

곧 자기개선한다. 매우 걱정됨

Q: What do you say to someone who might argue, if the systems become malevolent, just turn them off?

Q) 전원 끄면 되지 않나?

A: They will be able to manipulate people. And these will be very good at convincing people because, they'll have learned from all the novels that were ever written, all the books by Machiavelli, all the political connivances. They'll know all that stuff. They'll know how to do it.

인공지능이 우리를 속이는건 쉽다
걔는 모든 책. 모든 소설을 다 읽었다.
마키아밸리의 모든 책을 읽었다. 모든 것을 안다.
어떻게 우릴 속여야할지를 안다.

“We're entering a period of great uncertainty where we're dealing with things we've never dealt with before. And normally the first time you deal with something totally novel, you get it wrong.

And we can't afford to get it wrong with these things.

Because they might take over.

우린 새로운 시대에 진입한다
그리고 인공지능이 우릴 이기겠지