Researchers at MIT are investigating ways of making artificial neural networks’ decision-making more transparent. The researchers have developed a new algorithm that can automatically identify the most likely outcome for each decision made by an AI system. In a recent paper called “Rationalising Neural Predictions” MIT researchers designed a neural network that would be forced to explain why it reached a certain conclusion. In one unpublished work, they used the technique to identify explanatory phrases from several thousand biopsy reports. It provides a starting point for equipping neural networks with a higher degree of accountability for their decisions.
Researchers at MIT are investigating ways of making artificial neural networks’ decision-making more transparent. At present, artificial neural networks are not explicitly designed to reveal what factors prompted them to make a certain decision. In a recent paper called “Rationalising Neural Predictions” MIT researchers designed a neural network that would be forced to explain why it reached a certain conclusion. In one unpublished work, they used the technique to identify explanatory phrases from several thousand biopsy reports. It provides a starting point for equipping neural networks with a higher degree of accountability for their decisions.