The lightning talk on Explainable AI (XAI) presented by Manojkumar Parmar highlights the importance of understanding AI decisions and the implications of acknowledging the reasoning behind these decisions. Key challenges to adopting trustworthy AI include the opacity of machine learning models and the need for transparency, reliability, and rationality in their outputs. The document references various studies and examples to illustrate the need for explainable AI in real-world applications.