https://www.reddit.com/r/singularity/comments/1j5b46w/gpt45_seems_the_first_model_to_kinda_play/
프롬 이것만 줬다고함
You are in a game of Minecraft and have to make progress.
AVAILABLE MOVES:
point_at(x, y) : points at an x and y pos on the screen (x and y should be between 0 and 1, where 0 is the top left of the screen and 1 the bottom right)
walk("forward"/"backwards"/"left"/"right", seconds, jump=False/True) : walks in a direction for N seconds, while or while not jumping
click("LMB"/"RMB") : clicks the left or right mouse button
press("LMB"/"RMB", seconds) : holds down the left or right mouse button for N seconds
wait(seconds) : do nothing for N seconds
Describe this Minecraft screenshot in detail, and give the 2D coordinates of all main visible objects in this image. Give them in the format [x1, y1, x2, y2] where [0, 0] is the top-left of the screenshot and [1, 1] is the bottom right. Also give the estimated 3D distance to the object from the player, as precise as one decimal (e.g. object X is 3.4 blocks away).
Then, determine your next move(s) based on the GOAL. Think carefully. Reason step-by-step what to do to achieve the GOAL!
Finally, end your response with a list of moves to execute for the player. The list should be between four star (*) symbols.
For example...:
****
walk("forward", 5, jump=True)
point_at(0.5, 0.95)
press("LMB", 7)
****
To climb a mountain for five seconds, point downwards, and dig a hole for another 7 seconds.
IMPORTANT: - follow the exact format given. for example, when adding walk() to the list, always include a jump=True or jump=False.
- Most blocks take AT LEAST 4 seconds to break, some longer
- player walks 5 blocks per second, so do some math to ensure you don't walk too far
- If there is a clear hill (1 block higher terrain) you need to set jump to =True, but if not then set it to False
- You should point to targets before walking towards them
- Try not to get stuck in holes or pits
GOAL: Collect the most oak logs in Minecraft history
돈 많이 깨졌겠다
I had GPT-4.5-preview play Minecraft purely by giving it screenshots from the game (so the way humans play Minecraft), and asking what keys or mouse buttons to press. I gave it the goal to collect as many oak logs as possible. Most models, even reasoners like o1, quickly get stuck and don't really know what they're doing. GPT-4.5-preview actually seemed to find and hit lots of trees, and was able