Space Industry and Business News
ROBO SPACE
AI risks 'disaster' without 'cast-iron guarantees': expert
AI risks 'disaster' without 'cast-iron guarantees': expert
By Kilian FICHOU
Paris (AFP) Feb 6, 2025

Artificial intelligence (AI) systems must come with "cast-iron guarantees" against mass harm to humans, especially as the likelihood of their integration into weapons grows, a leading expert has told AFP.

Stuart Russell, Berkeley computer science professor and co-director of the International Association for Safe and Ethical AI (IASEAI), will be in Paris Thursday for scientific talks in the run-up to a global summit on AI technology on February 10-11.

US tech giant Google appears to have walked back its commitment to avoid working on AI-powered weapons and surveillance systems. What was your reaction?

Stuart Russell: I think it's unfortunate. The reason they instantiated their earlier policy against the use of AI in weapons was precisely because their own employees revolted... The Google employees were worried that their work would be used in weapons, not just for reconnaissance, but for killing people.

Now (Google) says they're willing to override the views of their employees, also the views of the vast majority of the public, who are also opposed to the use of AI in weapons.

Why might Google have made this change?

SR: The military market for AI is minuscule compared to the consumer market and the business market so this is not really about the opportunity to make money. This is really about improving their bargaining position with the US government.

It's not a coincidence that this change in policy comes with a new administration that has removed all the regulations on AI that were placed by the Biden administration and is now placing a huge emphasis on the use of AI for military prowess.

What are the main dangers of using AI in weapons?

SR: Small autonomous weapon systems... are the most dangerous in the sense that because they're small and cheap, non-state groups, terrorists, for example, can buy them by the million and use them to carry out enormous massacres.

(Such weapons) could be used in much more dangerous and harmful ways. For example, "kill anyone who fits the following description". And that description could be by age, by gender, by ethnic group, by religious affiliation, or even a particular individual.

Will AI be increasingly integrated into future weapons systems?

SR: There were, at last count, about 75 countries that had either developed or were using remotely piloted weapons. And I think most of those are in the process of thinking about how to convert them to fully autonomous weapons.

Ukraine has been an accelerator... that conflict has forced these weapon systems to evolve very quickly. And everyone else is looking at this.

It's quite possible that the next major conflict after Ukraine will be fought largely with autonomous weapons in a way that is currently unregulated. So we can only imagine the kinds of devastation and horrific impacts on civilians that might occur as a result.

But on the other hand, there are more than 100 countries that have already stated their opposition to autonomous weapons. And I think there's a good chance that we'll achieve the necessary majority in the United Nations General Assembly to have a resolution calling for a ban.

Should AI in general be more tightly regulated?

SR: Human extinction could result from AI systems that are much more intelligent than humans, and therefore much more capable of affecting the world than we are.

Governments must require cast-iron guarantees in the form of either statistical evidence or mathematical proof that can be inspected, that can be checked carefully. And anything short of that is just asking for disaster.

kf/tgb/jxb

GOOGLE

Related Links
All about the robots on Earth and beyond!

Subscribe Free To Our Daily Newsletters
Tweet

RELATED CONTENT
The following news reports may link to other Space Media Network websites.
ROBO SPACE
MIT engineers help multirobot systems stay in the safety zone
Boston MA (SPX) Feb 04, 2025
Drone shows are an increasingly popular form of large-scale light display. These shows incorporate hundreds to thousands of airborne bots, each programmed to fly in paths that together form intricate shapes and patterns across the sky. When they go as planned, drone shows can be spectacular. But when one or more drones malfunction, as has happened recently in Florida, New York, and elsewhere, they can be a serious hazard to spectators on the ground. Drone show accidents highlight the challenges of ... read more

ROBO SPACE
Alloy discovered that barely changes with temperature

Big Tech's AI spending rattles markets

Orbex lands D-Orbit deal prior to first mission this year

EdgeCortix unveils SAKURA-I with proven radiation immunity for orbital and lunar ventures

ROBO SPACE
Mobix Labs Secures Defense Funding to Advance SATCOM SoC Innovation

ESA and European Commission to establish secure quantum communications network

KP Labs and ESA Unveil PINEBERRY to Enhance AI Security and Transparency in Space Missions

ESA and Hisdesat prepare to launch advanced secure communications satellite

ROBO SPACE
ROBO SPACE
EUSPA unveils integrated GNSS and secure SATCOM user technology update

GMV to advance the Galileo High Accuracy Service with new data generator

Sierra Space resilient GPS Satellite Program achieves major development milestone

Slingshot Aerospace to enhance USSF technology for GPS jamming and spoofing detection

ROBO SPACE
NORAD responds to 'multiple' Russian jets near Alaska, Yukon

Japan scrambles jets as Russian bombers fly over high seas

UK eyes third Heathrow runway in growth takeoff bid

UK backs third Heathrow runway in growth takeoff bid

ROBO SPACE
Chipmaker Intel beats revenue expectations amidst Q4 loss

A spintronic perspective on chiral molecule interactions

Nvidia chief meets Trump amid AI trade tensions

Improving the way flash memory is made

ROBO SPACE
Zohar rides with SpaceX to enhance real time space weather coverage

Trump taps 'Sharpiegate' meteorologist to lead top science agency

GHGSAT Selected as Copernicus Contributing Mission by ESA and EU

Scientists cast doubt on famous US groundhog's weather forecasts

ROBO SPACE
No new clothes: S. Korean climate activist targets hyperconsumption

Trump slams paper straws, vows 'back to plastic'

Air pollution fuels lung cancer among non-smokers: study

Mafia waste victims seek justice in Italy's 'Land of Fires'

Subscribe Free To Our Daily Newsletters




The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.