Top

Robots that learn without code

In a groundbreaking discovery, researchers at the Creative Machines Lab at Columbia University have developed a method in which robots can discover their body shapes and movements by themselves without human intervention. With a simple 2D camera and sophisticated artificial intelligence programs, the robots are able to observe themselves in motion, chart their body characteristics, and retrain new actions or recover after an injury. The research outlined in the Nature Machine Intelligence journal is among the strongest movements towards having autonomous machines that learn.

Previously, robots required specific programming as well as clearly defined models for operating within the parameters set out. Excessive deviations from such parameters normally took human input for reprogramming or resetting the devices. The groundbreaking strategy that Columbia’s scientists have employed gives robots a capacity for self-discovery through glimpsing their image, much the same way a human would be able to master new motor activities by viewing itself on a reflective surface. Lead author Yuhang Hu explains, “Our dream is a robot that is familiar with its own body, adapts to damage, and learns new things without constant human teaching.”

Robots: Shaping the future of autonomous systems

The scientists used three deep neural networks to process 2D video inputs so that the robots could reason about their 3D movements and configurations. This capability enables robots to detect changes in their structure, such as wear and tear or unexpected damage, and adjust their actions accordingly to maintain functionality. For instance, when a robot limb is damaged, it can detect the malfunction and change its movement patterns to compensate for it, improving resilience and operational continuity.

This technology holds profound implications for the potential of autonomous systems across numerous sectors. Self-modelling robots can reduce dependency on human coders, leading to more efficient deployment within dynamic environments such as manufacturing, medicine, and disaster recovery. Self-evaluation and modification not only streamline operations but also enhance safety, as robots can proactively address malfunctions or react to unforeseen challenges.

Robots learn how to move by watching themselves – Columbia University

A growing trend in robotic self-learning

The construction of self-taught robots is a developing field of study within the field of robotics. For example, researchers at MIT have developed algorithms that enable robots to learn and refine skills like object manipulation without human intervention, enabling adaptation to new environments. Similarly, DeepMind’s RoboCat has been demonstrated to learn a large range of tasks and improve performance autonomously by generating its own training data. These simultaneous advances are indicative of a strong trend towards enabling machines to learn and adapt without direct human intervention.

While the technological potential is promising, it also comes with deep ethical and practical challenges. It is vital that self-learning robots are maintained within secure and predictable parameters, particularly in cases where they are directly engaging with individuals. Having robust frameworks for monitoring and guiding the machine’s learning processes will be vital to minimize risks associated with autonomous decision-making.

The work conducted by Columbia University’s Creative Machines Lab is a robotics breakthrough that brings the field one step closer to machines that learn independently and develop self-awareness. As these technologies advance, they can revolutionize industries with autonomous systems that are stronger, more flexible, and capable of performing complex tasks with minimal to no human input. However, as we include these smart machines in society, it is also important that we tackle their inherent ethical and safety issues in order to take maximum advantage of them.

George Mavridis is a journalist currently conducting his doctoral research at the Department of Journalism and Mass Media at Aristotle University of Thessaloniki (AUTH). He holds a degree from the same department, as well as a Master’s degree in Media and Communication Studies from Malmö University, Sweden, and a second Master’s degree in Digital Humanities from Linnaeus University, Sweden. In 2024, he completed his third Master’s degree in Information and Communication Technologies: Law and Policy at AUTH. Since 2010, he has been professionally involved in journalism and communication, and in recent years, he has also turned to book writing.