EXPLAINABLE AI
(XAI)
MANOJKUMAR PARMAR
ROBERT BOSCH ENGINEERING
AND BUSINESS SOLUTIONS
PRIVATE LIMITED, INDIA
LIGHTNING TALK AT
ICACCI’18 ON 21ST
SEPTEMBER 2019
SIMPLE QUESTION BUT FAR REACHING
IMPLICATION
AI : It’s a cat or
not?
Key Question:
“Why it’s a
cat?”
FROM RESEARCH
Brown, T. B., Mané, D., Roy, A., Abadi, M., & Gilmer, J. (2017).
Adversarial patch. arXiv preprint arXiv:1712.09665.
Kurakin, A., Goodfellow, I., & Bengio, S. (2016). Adversarial
examples in the physical world. arXiv preprint arXiv:1607.02533.
REAL WORLD EXAMPLES: MY EXPERIENCES
QUESTIONS WE CARE
Why did you do that?
Why not something else?
When do you succeed?
When do you fail?
When can I trust you?
How do I correct an error?
CHALLENGES TO ADOPTION
• ML/AI Models are Blackbox Models
• ML Models are Opaque, Non Intuitive and Difficult for people to understand
• Key Issue: Trustworthiness, reliability, rationality, and transparency of Models
• Decisions of Machine or action thereby have far reaching impact on Individual, society
or Government
Understanding Trust
Transparency Interaction
PERFORMANCE VS. EXPLAINABILITY
http://www.darpa.mil/attachments/DARPA-BAA-16-53.pdf
XAI
Example
http://www.darpa.mil/attachments/DARPA-BAA-16-53.pdf
XAI EMPHASIS
CURRENT
RESEARCH FIELDS
CONCEPTS AND
APPROACHES
http://www.darpa.mil/attachments/DARPA-BAA-16-53.pdf
REFERENCES
• Ribeiro, M. T., Singh, S., & Guestrin, C. (2016, August). Why should i trust you?: Explaining the
predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on
knowledge discovery and data mining (pp. 1135-1144). ACM.
• Fox, M., Long, D., & Magazzeni, D. Explainable Planning. In IJCAI-17 Workshop on Explainable AI (XAI)
• Gunning, D. (2017). Explainable artificial intelligence (xai). Defense Advanced Research Projects Agency
(DARPA), nd Web.
• Miller, T., Howe, P., & Sonenberg, L. (2017). Explainable AI: Beware of inmates running the asylum.
In IJCAI-17 Workshop on Explainable AI (XAI)
XAI: PATH TOWARDS FUTURE OF AI
THANK YOU!

Explainable AI (XAI)