AI and AI Safety: Reasons for AI Safety Research (Part 4)
Explore “Reasons for AI Safety Research” in this AI and AI Safety lesson. Part 4 of the five-part series brings together the source material and lesson topics. Use the contents links to find a section, read the notes, and consult the complete original teaching slides below.

Lesson topics
- As these examples illustrate, the concern about advanced AI isn’t malevolence but competence.
- WHY THE RECENT INTEREST IN AI SAFETY
Contents
- Read the original document
- As these examples illustrate, the concern about advanced AI isn’t malevolence but competence.
- WHY THE RECENT INTEREST IN AI SAFETY
- Since it may take decades to complete the required safety research, it is prudent to start it now.
REQUEST THE COMPLETE DOCUMENT ON WHATSAPP
Read the original source document
Artificial Intelligence – Gayathry Satheesan: original teaching slides for this study series.
As these examples illustrate, the concern about advanced AI isn’t malevolence but competence.
As these examples illustrate, the concern about advanced AI isn’t malevolence but competence. A super-intelligent AI will be extremely good at accomplishing its goals, and if those goals aren’t aligned with ours, we have a problem.
You’re probably not an evil ant-hater who steps on ants out of malice, but if you’re in charge of a hydroelectric green energy project and there’s an anthill in the region to be flooded, too bad for the ants. A key goal of AI safety research is to never place humanity in the position of those ants.
WHY THE RECENT INTEREST IN AI SAFETY
WHY THE RECENT INTEREST IN AI SAFETY Stephen Hawking, Elon Musk, Steve Wozniak, Bill Gates, and many other big names in science and technology have recently expressed concern in the media and via open letters about the risks posed by AI, joined by many leading AI researchers. The idea that the quest for strong AI would ultimately succeed was long thought of as science fiction, centuries or more away.
However, thanks to recent breakthroughs, many AI milestones, which experts viewed as decades away merely five years ago, have now been reached, making many experts take seriously the possibility of super intelligence in our lifetime.
Since it may take decades to complete the required safety research, it is prudent to start it now.
While some experts still guess that human-level AI is centuries away, most AI researches at the 2015 Puerto Rico Conference guessed that it would happen before 2060. Since it may take decades to complete the required safety research, it is prudent to start it now. Because AI has the potential to become more intelligent than any human, we have no surefire way of predicting how it will behave.
We can’t use past technological developments as much of a basis because we’ve never created anything that has the ability to, wittingly or unwittingly, outsmart us.
Review questions and answers
What are the key points about As these examples illustrate, the concern about advanced AI isn’t malevolence but competence.?
As these examples illustrate, the concern about advanced AI isn’t malevolence but competence. A super-intelligent AI will be extremely good at accomplishing its goals, and if those goals aren’t aligned with ours, we have a problem. You’re probably not an evil ant-hater who steps on ants out of malice, but if you’re in charge of a hydroelectric green energy…
What are the key points about WHY THE RECENT INTEREST IN AI SAFETY?
WHY THE RECENT INTEREST IN AI SAFETY Stephen Hawking, Elon Musk, Steve Wozniak, Bill Gates, and many other big names in science and technology have recently expressed concern in the media and via open letters about the risks posed by AI, joined by many leading AI researchers. The idea that the quest for strong AI would ultimately succeed was long thought of…
What are the key points about Since it may take decades to complete the required safety research, it is prudent to start it now.?
While some experts still guess that human-level AI is centuries away, most AI researches at the 2015 Puerto Rico Conference guessed that it would happen before 2060. Since it may take decades to complete the required safety research, it is prudent to start it now. Because AI has the potential to become more intelligent than any human, we have no surefire…
More lessons from this document
- Artificial Intelligence – Gayathry Satheesan — Part 1
- Artificial Intelligence – Gayathry Satheesan — Part 2
- Artificial Intelligence – Gayathry Satheesan — Part 3
- Artificial Intelligence – Gayathry Satheesan — Part 4
- Artificial Intelligence – Gayathry Satheesan — Part 5
Conclusion
The important points in WHY THE RECENT INTEREST IN AI SAFETY should be reviewed alongside the definitions, examples and comparisons given above. Continue with the other four articles to cover the rest of the source material.