The discussion emphasizes the importance of visual explanations in mathematics, suggesting these should focus on providing clarity rather than just enhancing formulas with color or notes. Various tools like Joyce's Java Version of Euclid's Elements and Unity tools by Freya Holmér are mentioned as effective in visualizing mathematical concepts. Commenters note the need for integration in existing mathematics technology, blending symbolic equations, illustrations, and runnable code to improve comprehension, as seen in the 'Caltech style' presentations. There's a sense of optimism for future advancements in this area, particularly regarding multimodal AI models that could automate the generation of these visual aids.