← thesingularity 게시판

[📪정보] 논문)소라는 놀라운 기하학적 일관성을 갖춘 비디오를 생성

익명(asdf045) 2024-02-29 03:21 추천 27

https://arxiv.org/abs/2402.17403

Sora Generates Videos with Stunning Geometrical ConsistencyThe recently developed Sora model [1] has exhibited remarkable capabilities in video generation, sparking intense discussions regarding its ability to simulate real-world phenomena. Despite its growing popularity, there is a lack of established metrics to evaluate its fidelity to real-world physics quantitatively. In this paper, we introduce a new benchmark that assesses the quality of the generated videos based on their adherence to real-world physics principles. We employ a method that transforms the generated videos into 3D models, leveraging the premise that the accuracy of 3D reconstruction is heavily contingent on the video quality. From the perspective of 3D reconstruction, we use the fidelity of the geometric constraints satisfied by the constructed 3D models as a proxy to gauge the extent to which the generated videos conform to real-world physics rules. Project page: https://sora-geometrical-consistency.github.io/arxiv.org

실제 물리학의 원리를 준수하여 벤치마크를 만들어서 그 동안 나온

비디도 생성 모델 테스트 해봄

측정 방식에 따라 점수의 높고 낮음으로 어느 모델이 더 좋은지 알수 있는데

소라가 압도적임

- dc official App

댓글 5

MoonChild(aowlr2001) 2024-02-29 03:22
점수차가 생각보다 더 심각한 듯

빙냥이ㄱㅇㅇ(6zd2cxvc44h4) 2024-02-29 05:53
HMX-13(multizzang) 2024-02-29 09:52
빠따죠

부패하는유전자!!!(sansss2015) 2024-02-29 13:56
익명(sukusuku7) 2024-02-29 15:11