This study presents a comparative analysis of various pretrained deep learning models for classifying heterogeneous Malayalam documents, specifically agreement documents, palm leaves, and notebook images, based on their structural features. The models tested include VGG-16, CNN, and AlexNet, with VGG-16 achieving the highest accuracy at 99.7%. The research emphasizes the importance of digitization and automated classification for effective document management due to the challenges posed by manual classification.