a robot about to walk off a cliff illustrates the limitations of AI awareness of their physical environment

This article is an excerpt from the Shortform book guide to "Rebooting AI" by Gary Marcus and Ernest Davis. Shortform has the world's best summaries and analyses of books you should be reading.

Like this article? Sign up for a free trial here.

What are the challenges of AI awareness in robotics? How do we ensure AI can safely navigate the real world?

In Rebooting AI, Gary Marcus and Ernest Davis explore the limitations of AI systems in understanding and interacting with physical environments. They discuss why traditional programming and machine learning fall short of equipping robots with the skills needed to function in complex, real-world scenarios.

Read more to understand why strong AI is crucial for safe and effective real-world interactions.

AI Awareness

While language-processing AI ignores the wider world, mapping and modeling objects in space is of primary concern in the world of robotics. Since robots and the AIs that run them function in the physical realm beyond the safety of mere circuit pathways, they must observe and adapt to their physical surroundings. Davis and Marcus describe how both traditional programming and machine learning are inadequate for the task of AI awareness, and they explore why future AIs will need a broader set of capabilities than we currently have in development if they’re to safely navigate the real world.

Robots are hardly anything new—we’ve had robotic machinery in factories for decades, not to mention the robotic space probes we’ve sent to other planets. However, all our robots are limited in function and the range of environments in which they operate. Before neural networks, these machines were either directly controlled or programmed by humans to behave in certain ways under specific conditions to carry out their tasks and avoid a limited number of foreseeable obstacles. 

(Shortform note: Despite Davis and Marcus’s statements to the contrary, we’ve developed robots that can overcome obstacles in environments outside of human control—most notably the autonomous rovers sent to explore the surface of Mars. Because of the lightspeed time delay between Earth and Mars, the rovers can’t be driven remotely. Instead, the rovers are empowered to pick objects for study based on their own direct observations, as well as to make their own course corrections to avoid potential hazards and other obstacles. The Perseverance rover autonomously explored nearly 18 kilometers of Mars’s surface in 2021 alone, surviving in a much more open terrain than the ideal laboratory conditions Davis and Marcus write about.)

Real-World Complexity

With machine learning’s growing aptitude for pattern recognition, neural network AIs operating in the real world are getting better at classifying the objects that they see. However, statistics-based machine learning systems still can’t grasp how real-world objects relate to each other, nor can AIs fathom how their environment can change from moment to moment. Researchers have made progress on the latter issue using video game simulations, but Marcus and Davis argue that an AI-driven robot in the real world could never have time to simulate every possible course of action. If someone steps in front of your self-driving car, you don’t want the car to waste too much time simulating the best way to avoid them.

AI Awareness: Does Artificial Intelligence Know Where It Is?

———End of Preview———

Like what you just read? Read the rest of the world's best book summary and analysis of Gary Marcus and Ernest Davis's "Rebooting AI" at Shortform.

Here's what you'll find in our full Rebooting AI summary:

  • That AI proponents oversell what modern AI can accomplish
  • How AI in its current form underdelivers on its creators’ promises
  • The real danger—and promise—of artificial intelligence

Elizabeth Whitworth

Elizabeth has a lifelong love of books. She devours nonfiction, especially in the areas of history, theology, and philosophy. A switch to audiobooks has kindled her enjoyment of well-narrated fiction, particularly Victorian and early 20th-century works. She appreciates idea-driven books—and a classic murder mystery now and then. Elizabeth has a Substack and is writing a book about what the Bible says about death and hell.

Leave a Reply

Your email address will not be published. Required fields are marked *