Microsoft
The technology behind ChatGPT has the potential to do more than just talk. Linxi Jim Fan, an AI researcher at chipmaker Nvidia, worked with colleagues to devise a way to set up the powerful GPT-4 language model, the brains behind ChatGPT and a growing number of other free apps and services. inside the block video game Minecraft.
The Nvidia team, which included Anima Anandkumar, the company’s director of machine learning and a professor at Caltech, created a Minecraft bot called Voyager that uses GPT-4 to fix in-game problems. The language model generates goals that help the agent navigate the game and code that improves the bot’s ability to play the game over time.
Voyager doesn’t play as a person, but can read the game state directly, via an API. She might see a fishing rod in her inventory and a river nearby, for example, and use GPT-4 to suggest a goal to fish to gain experience. She will then use this goal to have GPT-4 generate the code needed for the character to achieve it.
The most innovative part of the project is the code generated by GPT-4 to add behaviors to Voyager. If the initially suggested code doesn’t work perfectly, Voyager will try to improve it using error messages, in-game feedback, and a description of the GPT-4 generated code.
Over time, Voyager builds a library of code to learn how to build more and more complex things and explore more parts of the game. A graph created by the researchers shows how capable it is compared to others Minecraft agents. Voyager obtains more than three times as many items, explores more than twice as much and builds tools 15 times faster than other AI agents. Fan says the approach could be improved in the future by adding a way for the system to incorporate visual information from the game.
While chatbots like ChatGPT have wowed the world with their eloquence and seeming knowledge, even though they often invent things, Voyager shows the huge potential of language models to perform useful actions on computers. Using language models in this way could perhaps automate many routine office tasks, potentially one of the technology’s biggest economic impacts.
The process Voyager uses with GPT-4 to figure out how to do things Minecraft it could be adapted for a software assistant that solves how to automate tasks through the operating system on a PC or phone. OpenAI, the startup behind ChatGPT, has added plugins to the bot that allow it to interact with online services like grocery delivery app Instacart. Microsoft, which owns Minecraft, is also training AI programs to reproduce it, and the company recently announced Windows 11 Copilot, an operating system feature that will use machine learning and APIs to automate certain tasks. It might be a good idea to experiment with this kind of technology within a game like Minecraftwhere the faulty code can do relatively little harm.
Video games have long been a testing ground for AI algorithms, of course. AlphaGo, the machine learning program that has mastered the extremely thin board game Go in 2016, he cut his teeth playing simple Atari video games. AlphaGo used a technique called reinforcement learning, which trains an algorithm to play a game by giving it positive and negative feedback, such as from your score within a game.
It’s harder for this method to lead an agent in an open-ended game like Minecraft, where there is no scoring or streak, and where a player’s actions may not pay off until much later. Whether or not you believe we should be preparing to contain the existential threat of AI right now, Minecraft it looks like an excellent playground for technology.
This story originally appeared on wired.com.
#connected #GPT4 #Minecraft #unearthed #potential