From Fareed’s website of Thursday April 13, 2017:
The Deep Danger of AI
The growing embrace of artificial intelligence and “deep learning” raises an important – and potentially troubling – issue, writes Will Knight in MIT Technology Review. What if we can no longer understand the decisions machines make?
“There’s already an argument that being able to interrogate an AI system about how it reached its conclusions is a fundamental legal right. Starting in the summer of 2018, the European Union may require that companies be able to give users an explanation for decisions that automated systems reach,” Knight says.
“This might be impossible, even for systems that seem relatively simple on the surface, such as the apps and websites that use deep learning to serve ads or recommend songs. The computers that run those services have programmed themselves, and they have done it in ways we cannot understand. Even the engineers who build these apps cannot fully explain their behavior.”