AI and AI Safety: Potential Risks of Advanced AI (Part 3)
Explore “Potential Risks of Advanced AI” in this AI and AI Safety lesson. Part 3 of the five-part series brings together the source material and lesson topics. Use the contents links to find a section, read the notes, and consult the complete original teaching slides below.
Lesson topics
- HOW CAN AI BE DANGEROUS?
- In the hands of the wrong person, these weapons could easily cause mass casualties.
Contents
- Read the original document
- By inventing revolutionary new technologies, such a super intelligence might help us eradicate war, disea
- At FLI we recognize both of these possibilities, but also recognize the potential for an artificial intel
- HOW CAN AI BE DANGEROUS?
- In the hands of the wrong person, these weapons could easily cause mass casualties.
- The AI is programmed to do something beneficial, but it develops a destructive method for achieving its g
REQUEST THE COMPLETE DOCUMENT ON WHATSAPP
Read the original source document
Artificial Intelligence – Gayathry Satheesan: original teaching slides for this study series.
By inventing revolutionary new technologies, such a super intelligence might help us eradicate war, disea
By inventing revolutionary new technologies, such a super intelligence might help us eradicate war, disease, and poverty, and so the creation of strong AI might be the biggest event in human history. Some experts have expressed concern, though, that it might also be the last, unless we learn to align the goals of the AI with ours before it becomes super intelligent.
There are some who question whether strong AI will ever be achieved, and others who insist that the creation of super intelligent AI is guaranteed to be beneficial.
At FLI we recognize both of these possibilities, but also recognize the potential for an artificial intel
At FLI we recognize both of these possibilities, but also recognize the potential for an artificial intelligence system to intentionally or unintentionally cause great harm. We believe research today will help us better prepare for and prevent such potentially negative consequences in the future, thus enjoying the benefits of AI while avoiding pitfalls.
HOW CAN AI BE DANGEROUS?
HOW CAN AI BE DANGEROUS? Most researchers agree that a super intelligent AI is unlikely to exhibit human emotions like love or hate, and that there is no reason to expect AI to become intentionally benevolent or malevolent. Instead, when considering how AI might become a risk, experts think two scenarios most likely:
The AI is programmed to do something devastating: Autonomous weapons are artificial intelligence systems that are programmed to kill.
In the hands of the wrong person, these weapons could easily cause mass casualties.
In the hands of the wrong person, these weapons could easily cause mass casualties. Moreover, an AI arms race could inadvertently lead to an AI war that also results in mass casualties. To avoid being thwarted by the enemy, these weapons would be designed to be extremely difficult to simply “turn off,” so humans could plausibly lose control of such a situation.
This risk is one that’s present even with narrow AI, but grows as levels of AI intelligence and autonomy increase.
The AI is programmed to do something beneficial, but it develops a destructive method for achieving its g
The AI is programmed to do something beneficial, but it develops a destructive method for achieving its goal: This can happen whenever we fail to fully align the AI’s goals with ours, which is strikingly difficult.
If you ask an obedient intelligent car to take you to the airport as fast as possible, it might get you there chased by helicopters and covered in vomit, doing not what you wanted but literally what you asked for. If a super intelligent system is tasked with a ambitious reengineering project, it might wreak havoc with our ecosystem as a side effect, and view human attempts to stop it as a threat to be met.
Review questions and answers
What are the key points about By inventing revolutionary new technologies, such a super intelligence might help us eradicate war, disea?
By inventing revolutionary new technologies, such a super intelligence might help us eradicate war, disease, and poverty, and so the creation of strong AI might be the biggest event in human history. Some experts have expressed concern, though, that it might also be the last, unless we learn to align the goals of the AI with ours before it becomes super…
What are the key points about At FLI we recognize both of these possibilities, but also recognize the potential for an artificial intel?
At FLI we recognize both of these possibilities, but also recognize the potential for an artificial intelligence system to intentionally or unintentionally cause great harm. We believe research today will help us better prepare for and prevent such potentially negative consequences in the future, thus enjoying the benefits of AI while avoiding pitfalls.
What are the key points about HOW CAN AI BE DANGEROUS??
HOW CAN AI BE DANGEROUS? Most researchers agree that a super intelligent AI is unlikely to exhibit human emotions like love or hate, and that there is no reason to expect AI to become intentionally benevolent or malevolent. Instead, when considering how AI might become a risk, experts think two scenarios most likely: The AI is programmed to do something…
What are the key points about In the hands of the wrong person, these weapons could easily cause mass casualties.?
In the hands of the wrong person, these weapons could easily cause mass casualties. Moreover, an AI arms race could inadvertently lead to an AI war that also results in mass casualties. To avoid being thwarted by the enemy, these weapons would be designed to be extremely difficult to simply “turn off,” so humans could plausibly lose control of such a…
What are the key points about The AI is programmed to do something beneficial, but it develops a destructive method for achieving its g?
The AI is programmed to do something beneficial, but it develops a destructive method for achieving its goal: This can happen whenever we fail to fully align the AI’s goals with ours, which is strikingly difficult. If you ask an obedient intelligent car to take you to the airport as fast as possible, it might get you there chased by helicopters and covered…
More lessons from this document
- Artificial Intelligence – Gayathry Satheesan — Part 1
- Artificial Intelligence – Gayathry Satheesan — Part 2
- Artificial Intelligence – Gayathry Satheesan — Part 3
- Artificial Intelligence – Gayathry Satheesan — Part 4
- Artificial Intelligence – Gayathry Satheesan — Part 5
Conclusion
The important points in HOW CAN AI BE DANGEROUS? should be reviewed alongside the definitions, examples and comparisons given above. Continue with the other four articles to cover the rest of the source material.