How Competitions Are Making Better Robot Standards

Beyond the fun, there are some big reasons why Standards Organizations use competitions to advance standards development

Aug 09, 2024

“I never lose. I either win or I lean.” - Nelson Mandela

Typically, standards development is seen as a pretty dull, thankless job. That is the opinion of many; they are also the opinion of those who have not participated in a challenge that helps test and make the standard better.

For this week’s column, I want to discuss the growing role of competitions and how they are being used to “field test” a potentially new standard prior to publication. They can also help identify how to improve existing standards while providing early insight into future standards that will be needed.

Now, granted, not every standard can be written/developed in a way that a competition can support. However, so many standards support other standards, and if we can strengthen as many supporting standards as possible via competitions, then we are strengthening the entire standards ecosystem.

2023 NIST Quadruped Challenge at ICRA-London

What Are Some Of These Competitions?

While various organizations organize several types of competitions, I will list three that are close to me and my team at ASTM International.

The NIST Quadruped Challenge is held at numerous conferences, such as IEEE’s ICRA and IROS, but it supports the work of the ASTM F54.09 Response Robots committee.
The ASTM Exo Center of Excellence Exo Games is a partnership between NIST and ASTM and supports the work of the ASTM F48 Exoskeletons and Exosuits committee.
Robotic Grasping and Manipulation Competition - part of IEEE’s ICRA, but also supports the work for ASTM F45.05 Robot Grasping and Manipulation committee.

Competitions like these play a crucial role in improving standards development. These events provide a controlled environment where various robotic systems and technologies are tested against the set criteria in the new proposed standard or an updated standard. The competition format encourages innovation, as participants strive to meet or exceed these standards. This iterative testing and evaluation process helps identify the strengths and weaknesses of different approaches, leading to the refinement of performance metrics and test methods.

Moreover, these competitions foster collaboration among researchers, industry experts, and standardization bodies. Teams must not be limited to their school or a particular robot. The Exo Games regularly has schools teaming up to form single teams. The Quadruped and Grasping challenges are open to any type of robot (as long as there is no clear advantage). In most cases, the competition puts limits to ensure that as many apple-to-apple comparisons can be made. By showcasing real-world applications and outcomes, they offer valuable insights into the practical challenges and solutions associated with new technologies. This collaborative environment accelerates the development of robust, reliable standards that can be widely adopted.

Additionally, competitions help ensure that standards remain relevant and adaptable to emerging technologies. They provide a dynamic platform for continuous improvement, allowing standards to evolve in line with technological advancements. This process helps bridge the gap between theoretical research and practical implementation, ultimately leading to the development of more effective, universally accepted standards that drive progress in the robotics industry.

How Competitions Advance Standards Development

While already stated some of the reasons of why competitions help, there are some of other benefits to competitions and the role the play in the standards development community.

Innovation and Fresh Perspectives

Competitions encourage students to bring new ideas and innovative solutions to real-world problems, which can influence the evolution of existing standards or the creation of new ones.

The old adage of “getting a fresh pair of eyes on it” is one of the biggest reasons to hold a competition, especially with students. They are still early in their journeys and will not have the “well we’ve always done it this way” mentality. Give them the baseline parameters of the standard and let them put it to the test. The results are always going to be something you weren’t expecting. This counts to us that run the competitions. We want to see the new perspectives. Because it will be these new perspectives that will challenge the next wave of standards that will be needed by those new thoughts.

Education and Awareness

These competitions raise awareness about the importance of standards among the next generation of engineers and scientists, promoting a culture of standardization from an early stage in their careers. Exposing the next generation to standards through these competitions is another big part of keeping standards making fresh.

This also gets them off on the right foot in their careers because they learn early that there are standards. There is a process behind how they are created and tested to ensure they are relevant. Standards making is a team sport, so bringing that teamwork component is just another part of how competitions lead to better standards through teamwork. The competitions also show right away that standards development does have its moments of fun.

The Benchmark Autonomous Robot Navigation (BARN) Challenge at ICRA 2024 in Yokohama, Japan

Practical Applications

Practical applications are a critical component of student competitions in standards development, providing students with invaluable hands-on experience in applying standards to real-world projects. Through these competitions, students are tasked with developing solutions that must comply with existing standards, allowing them to understand the practical aspects and significance of standard compliance in technology and engineering.

By working on these projects, students learn how standards are implemented in various phases of development, from design to execution, and how they ensure interoperability, safety, and quality. This process demystifies standards, transforming them from abstract guidelines into essential tools that govern their work. This experiential learning helps students appreciate standards’ critical role in achieving consistency, reliability, and efficiency in their projects.

Furthermore, these practical experiences highlight the challenges and limitations of current standards, prompting students to think critically and innovatively. As they navigate these challenges, students often develop novel solutions and approaches that can inform the evolution of existing standards or the development of new ones. This iterative process not only enhances their problem-solving skills but also fosters a mindset geared towards continuous improvement and innovation.

The UK Atomic Energy Authority leverages a Challenge for Test Methods to train future remote operators of robotics

Industry Collaboration

Finally, competitions often involve partnerships with industry leaders, exposing students to industry standards and practices. These competitions provide a unique platform where theoretical knowledge meets practical industry challenges, creating a symbiotic environment beneficial to both participants and organizations.

For the Grasping Challenge, ASTM was joined by other organizations like Amazon Robotics and Mathworks, who are also strongly interested in what the students are coming up with. these competitions serve as a fertile ground for innovation and talent discovery. By partnering with educational institutions and hosting or sponsoring competitions, companies can tap into students' creative potential and fresh perspectives. This interaction often leads to innovative solutions that address current challenges and identify potential areas for new standards. The insights gained from these competitions can inform the evolution of existing standards or the creation of new ones, ensuring they remain relevant and forward-looking.

Moreover, industry competitions facilitate valuable networking opportunities. Students have the chance to interact with industry professionals, fostering mentorship relationships that can significantly impact their career trajectories. These connections provide guidance and inspiration and help students understand the professional landscape and the importance of standards in maintaining quality and safety.

For the industry, these competitions are a strategic tool for talent development. Organizations can identify and nurture promising individuals who demonstrate a keen understanding of standards and a capacity for innovation. This ensures a continuous flow of knowledgeable contributors to the standards community, vital for sustaining progress and innovation. Amazon’s famous PICK CHALLENGE started out as another challenge at ICRA, but it opened up a whole new world of robotics for Amazon when they kicked it off back in 2015. So it isn’t just to advance the standards, but also the technology at hand.

The first Amazon Picking Challenge in 2015

TL;DR

Student competitions are vital for advancing standards development by infusing innovation, practical applications, and industry collaboration. They offer a platform for testing and refining standards before publication, ensuring their real-world effectiveness.

These events bring fresh perspectives and innovative solutions that challenge and improve existing standards, driving progress in the field. Students gain invaluable hands-on experience, demystifying standards and turning abstract concepts into essential tools that govern their work.

Moreover, industry collaboration through these competitions leads to innovative solutions and exposure to current industry practices, fostering mentorship relationships that influence students’ career trajectories. Competitions also serve as strategic tools for talent development, ensuring a continuous flow of knowledgeable contributors to the standards community.

Robot News Of The Week

Soft Robotics exits gripper business, launches AI-focused company

Industrial robot sales have declined significantly in North America, dropping 30% in 2023 and 6% in Q1 2024 compared to Q1 2023, after booming during the COVID-19 pandemic. This decline has led to shutdowns and layoffs in the robotics industry. Soft Robotics Inc. sold its soft robotic gripper business to J. Schmalz GmbH, while spinning off its mGripAI 3D vision and AI technologies into a new company, Oxipital AI. Oxipital AI focuses on AI visual inspection tasks, particularly in the food industry, where it aims to improve processes without replacing human labor with robots.

Chinese-made humanoid robots raise alarms in Congress: ‘Stealth army on our land’

Advanced Chinese-made robots with eerily lifelike capabilities are poised to enter the global market. US lawmakers are already demanding that they be banned in the US. One leading Chinese firm, Unitree Robotics, has developed a $90,000 robot capable of running at speeds of up to 11 mph. Many other firms have similar products under development. Jacob Helberg, a member of the US-China Economic and Security Review Commission, has warned Congress about the risks of allowing the sale of robots made by firms beholden to Beijing.

Epson Robots expands six-axis robot line with compact, collaborative C-B series

Epson Robots has introduced the new C-B series six-axis robots, featuring the RC700E controller and integrated SafeSense technology. These models are designed for precision, flexibility, and efficiency in industrial environments. Epson Robots aims to meet the demanding needs of high-tech automation users with these innovative features. The company has utilized its four decades of experience in the field to develop the C-B series, underscoring its commitment to advancing industrial automation with cutting-edge solutions.

Robot Research In The News

Using photos or videos, these AI systems can conjure simulations that train robots to function in physical spaces

Researchers from the University of Washington have developed two AI systems, RialTo and URDFormer, to create simulations for training robots using videos or photos, significantly reducing training costs. RialTo allows users to scan a space with a smartphone, creating a "digital twin" where robots can learn tasks through virtual repetition. URDFormer uses internet images to generate numerous simulation environments, training robots quickly and cheaply, though with less accuracy. These systems aim to improve robot functionality in dynamic environments like homes. RialTo and URDFormer were presented at the Robotics Science and Systems conference and promise to democratize robot training technology, enabling robots to work effectively and safely in real-world settings.

Achieving Human-Level Competitive Robot Table Tennis

Google DeepMind has developed a robot that plays table tennis at an amateur human level. The robot, equipped with a 6 DoF ABB 1100 arm on linear gantries, was tested against human players of varying skills, winning 45% of matches overall. This achievement highlights the potential of AI and robotics in mimicking complex human activities.

Robot Workforce Story Of The Week

Robots bring mothers and daughters together

Girls at Turtle Creek Elementary STEAM Academy near Pittsburgh get to teach their mothers how to build robots and explore engineering and computer programming together.

Robot Video Of The Week

The BMW Group is testing humanoid robots in production for the first time, using Figure 02 from California's Figure at their Spartanburg plant. This robot successfully inserted sheet metal parts into fixtures, reducing ergonomically challenging tasks for employees. The trial run provided valuable insights into integrating multi-purpose robots into existing systems. Milan Nedeljković of BMW AG highlights their goal of advancing this technology from development to industrialization. Figure 02, boasting advanced dexterity, processing power, and human-like capabilities, is being developed further for future applications in production, aiming to improve ergonomics and safety.