A Comprehensive Analysis of Artificial Intelligence Concepts and Applications in Cultural Heritage and Arts – From Archaeology to the Metaverse Reality

Ghodousiyan, Talhe; Razani, Mehdi; Mehdikhani, Amir Hossein; Keshtkar, Arash; Mirzaie, Ali Kh; Mansouri, Alireza; Kiaei , Ali Akbar; Shirazi , Hossein; Dehpahlavan, Mustafa; Hosseinbor, Abdolbasir

doi:10.61882/kcr.7.3.39

Danesh

Hefazat va Maremat

EN FA

Volume 7, Issue 3 (11-2024) KCR 2024, 7(3): 39-50 | Back to browse issues page

‎ 10.61882/kcr.7.3.39

Mendeley

Zotero

RefWorks

Ghodousiyan T, Razani M, Mehdikhani A H, Keshtkar A, Mirzaie A K, Mansouri A, et al . A Comprehensive Analysis of Artificial Intelligence Concepts and Applications in Cultural Heritage and Arts – From Archaeology to the Metaverse Reality. KCR 2024; 7 (3) :39-50
URL: http://journal.richt.ir/kcr/article-1-223-en.html

A Comprehensive Analysis of Artificial Intelligence Concepts and Applications in Cultural Heritage and Arts – From Archaeology to the Metaverse Reality

Talhe Ghodousiyan ^*

, Mehdi Razani

, Amir Hossein Mehdikhani

, Mustafa Dehpahlavan

, Abdolbasir Hosseinbor

Machine Learning Researcher, NOAI (ArchAI) & Machine Learning Researcher, NOAI (ArchAI)

Abstract: (4398 Views)

Artificial intelligence (AI) and machine learning (ML) have emerged as transformative tools in preserving, analyzing, and representing cultural heritage and arts. This article provides a systematic and comprehensive review of AI applications in this domain, exploring their potential to address longstanding challenges such as natural degradation, limited accessibility, and complex documentation. By integrating classical and advanced ML algorithms, we examine case studies including the Time Machine Europe project, the Ithaca model for ancient Greek texts, and metaverse-based heritage digitization. These initiatives demonstrate AI’s capacity to enhance precision, speed, and interactivity in heritage tasks, from virtual reconstruction to multimodal data analysis. However, limitations such as data quality, ethical concerns, and computational complexity pose significant barriers to widespread adoption. Emerging technologies like non-fungible tokens (NFTs), prompt engineering, and quantum AI are highlighted as future directions that promise further innovation. This study underscores the need for interdisciplinary collaboration and ethical frameworks to ensure sustainable advancements, offering a roadmap for researchers and policymakers in the digital era.

Keywords: Cultural Heritage, Artificial Intelligence (AI), Machine Learning (ML), Computer Vision, Natural Language Processing, Digital Preservation Metaverse.

Full-Text [PDF 8690 kb] (1222 Downloads)

Type of Study: Review Article | Subject: Application of modern sciences, technologies, equipment, materials and methods
Received: 2024/07/22 | Accepted: 2024/11/18 | Published: 2024/11/30

References

1. Agapiou, A., Lysandrou, V., & Hadjimitsis, D. G. (2020). Remote sensing archaeology: Tracking the past with the help of modern technology. Remote Sensing, 12 (5), 827. https://doi.org/10.3390/rs12050827.

2. Art, in, History, June 25th, T. |, & Comment, 2021 Leave a. (n.d.). The long-lost pieces of Rembrandt’s Night Watch get reconstructed with artificial intelligence. Open Culture. Retrieved March 18, 2025, from https://www.openculture. c o m / 2 0 2 1 / 0 6 / t h e - l o ng - l o s t - p i e c e s - o f -rembrandts-night-watch-get-reconstructed-with-artificial-intelligence.html.

3. ATM timeslider in Netherlands 3D – Amsterdam Time Machine. (n.d.). Retrieved March 18, 2025, from https://www.amsterdamtimemachine.nl/nl/atm-timeslider-in-netherlands-3d/.

4. Autoencoders in Deep Learning: Tutorial & Use Cases [2024]. (n.d.). Retrieved March 18, 2025, from https://www.v7labs.com/blog/autoencoders-guide.

5. Bishop, C. M. (2006). Pattern recognition and machine learning. Springer.

6. Bishop, C. M., & Bishop, H. (2024a). Deep learning: Foundations and concepts. Springer International Publishing. https://doi.org/10.1007/978-3-031-45468-4.

7. Bishop, C. M., & Bishop, H. (2024b). Graph neural networks. In C. M. Bishop & H. Bishop (Eds.), Deep learning: Foundations and concepts (pp. 407–427). Springer International Publishing. https://doi.org/10.1007/978-3-031-45468-4_13.

8. Breiman, L. (2001). Random forests. Machine Learning, 45 (1), 5–32. https://doi.org/10.1023/A:1010933404324.

9. Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., … & Amodei, D. (2020). Language models are few-shot learners. Advances in Neural Information Processing Systems, 33, 1877–1901.

10. Buchanan, B. G., & Shortliffe, E. H. (1984). Rule-based expert systems: The MYCIN experiments of the Stanford heuristic programming project. Addison-Wesley.

11. Buragohain, D., Meng, Y., Deng, C., Li, Q., & Chaudhary, S. (2024). Digitalizing cultural heritage through metaverse applications: Challenges, opportunities, and strategies. Heritage Science, 12(1), 1–16. https://doi.org/10.1186/s40494-024-01403-1.

12. Cadena SER. (2024, December 30). "Txikito", el personaje interactivo que enseña danzas vascas con inteligencia artificial. Retrieved from https://cadenaser.com/euskadi/2024/12/30/txikito-el-personaje-interactivo-que-ensena-danzas-vascas-con-inteligencia-artificial-radio-bilbao/.

13. Caron, M., et al. (2021). Emerging properties in self-supervised vision transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) (pp. 9650–9660). https://arxiv.org/abs/2104.14294.

14. Chen, F., Lasaponara, R., & Masini, N. (2020). Exploiting satellite SAR for archaeological prospection and heritage site protection. Geospatial Information Science, 27 (3), 526–551. http://doi.org/10.1080/10095020.2023.2223603.

15. Chen, Y., et al. (2024). Digital technology in cultural heritage: Construction and evaluation of a high-quality Chinese Manchu music dataset. Applied Sciences, 14 (23), 10811. https://doi.org/10.3390/app142310811.

16. Codemax. (2023). AI in cultural heritage preservation: Digitizing and conserving artifacts. Retrieved from https://codemax.app/explore/ai-in-cultural-heritage-preservation-digitizing-and-conserving-artifacts/.

17. Davoudi, H., Fiorucci, M., & Traviglia, A. (2021). Ancient document layout analysis: Autoencoders meet sparse coding. In From digital recording to advanced AI applications in cultural heritage (pp.1–12). Springer. https://doi.org/10.1007/978-3-031-27330-8_69.

18. Dore, C., & Murphy, M. (2020). Implementing artificial intelligence in H-BIM using the J48 algorithm to manage historic buildings. International Journal of Architectural Heritage. Retrieved from https://community.graphisoft. com/gowhw84577/attachments/gowhw84577.

19. Efthymiou, A., Rudinac, S., Kackovic, M., Worring, M., & Wijnberg, N. (2021). Graph neural networks for knowledge enhanced visual representation of paintings. arXiv preprint arXiv:2105.08190.

20. Falk, J. H., & Dierking, L. D. (2024). Rethinking museum visitors: Using K-Means cluster analysis to explore a museum's audience. Visitor Studies, 27 (1), 1–18.

21. Fiorucci, M., Khoroshiltseva, M., Pontil, M., Traviglia, A., Del Bue, A., & James, S. (2020). Machine learning for cultural heritage: A survey. Pattern Recognition Letters, 133, 102–108. https://doi.org/10.1016/j.patrec.2020.02.017.

22. Frohlich, R., Gubo, S., Lévai, A., & Kato, Z.(2018). 3D–2D data fusion in cultural heritage applications. In B. Chanda, S. Chaudhuri, & S. Chaudhury (Eds.), Heritage preservation (pp.111–130). Springer. https://doi.org/10.1007/978-981-10-7221-5_6.

23. Gaber, J. A., et al. (2023). The role of artificial intelligence and machine learning in preserving cultural heritage and artworks via virtual restoration. ISPRS Annals, X-1/W1-2023, 185–190. https://doi.org/10.5194/isprs-annals-X-1-W1-2023-185-2023.

24. García-Gonzalo, E., Fernández-Muñiz, Z.,García Nieto, P. J., Bernardo Sánchez, A., &Menéndez Fernández, M. (2016). Hard-rock stability analysis for span design in entry-type excavations with learning classifiers. Materials, 9(7), 531. https://doi.org/10.3390/ma9070531.

25. Gomes, J., & Silva, D. (2021). Dominant color extraction with K-Means for camera characterization. Remote Sensing, 12 (3), 520.

26. Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. MIT Press.

27. Gupta, R., Sharma, P., & Zhang, T. (2023). Vision transformers in art authentication: A novel approach. Retrieved from https://link.springer.com.

28. Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning: Data mining, inference, and prediction (2nd ed.). Springer.

29. Hutson, J. (2024). Combining large language models and immersive technologies to represent cultural heritage in the metaverse context. In Augmented and virtual reality in the metaverse (pp.265–281). Springer. https://doi.org/10.1007/978-3-031-57746-8_14.

30. Hype Cycle for Generative AI 2024. (n.d.). Gartner. Retrieved March 18, 2025, from https://www.gartner.com/en/articles/hype-cycle-for-genai.

31. Janković Babić, R. (2024). A comparison of methods for image classification of cultural heritage using transfer learning for feature extraction. Neural Computing and Applications, 36, 11699–11709. https://doi.org/10.1007/s00521-023-08764-x.

32. Jurafsky, D., & Martin, J. H. (2025). Speech and language processing (3rd ed. draft). Stanford. https://web.stanford.edu/~jurafsky/slp3/.

33. Kaštelan, N., Vujović, I., Krčum, M., & Assani, N. (2022). Switchgear digitalization—Research path, status, and future work. Sensors, 22 (20),7922. https://doi.org/10.3390/s22207922.

34. Khemani, B., Patil, S., Kotecha, K., & Tanwar, S. (2024). A review of graph neural networks: Concepts, architectures, techniques, challenges, datasets, applications, and future directions. Journal of Big Data, 11 (1), 18. https://doi.org/10.1186/s40537-023-00876-4.

35. Kipf,T.N.,&Welling,M.(2017). Semi-supervised classification with graph convolutional networks. ICLR. https://arxiv.org/abs/1609.02907.

36. Koutsoudis, A., Pavlidis, G., & Tsiafakis, D.(2023). Large language models as recommendation systems in museums. Electronics, 12 (18), 3829. https://doi.org/10.3390/electronics12183829.

37. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems, 25,1097–1105.

38. Lasaponara, R., & Masini, N. (2012). Satellite remote sensing: A new tool for archaeology. Springer.

39. LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521 (7553), 436–444. https://doi.org/10.1038/nature14539.

40. Li, Z., & Zhang, H. (2024). Combining CNN and Transformers for artistic style classification. Retrieved from https://arxiv.org/abs/2502.18083.

41. Luo, L., Wang, X., Guo, H., Liu, C., Liu, J., Li, L., ... & Ji, W. (2019). Automated detection of archaeological mounds using machine-learning classification of multisensor and multitemporal satellite data. Proceedings of the National Academy of Sciences, 116 (31), 18219–18224.

42. Mafi, S., Dehpahlavan, M., & Aarab, A. (2022). Classification and typology of Iron Age II pottery from excavations of Qareh Tepe of Sagzabad, Qazvin using radius, tangent and curvature (RTC) functions of the lip profile of pottery vessels. Journal of Research on Archaeometry, 8 (2), 147–163. https://doi.org/10.52547/jra.8.2.147.

43. Mantovan, L., & Nanni, L. (2020). The computerization of archaeology: Survey on artificial intelligence techniques. SN Computer Science, 1 (267).

44. Marchello, G., et al. (2023). Cultural heritage digital preservation through AI-driven robotics. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLVIII-M-2-2023 , 995–1000. https://doi.org/10.5194/isprs-archives-XLVIII-M-2-2023-995-2023.

45. Mitchell, T. M. (1997). Machine learning. McGraw-Hill.

46. Mishra, M., & Lourenço, P. B. (2024). Artificial intelligence-assisted visual inspection for cultural heritage: State-of-the-art review. Journal of Cultural Heritage, 66, 536–550. https://doi.org/10.1016/j.culher.2024.01.005.

47. Nguyen, T. T., & Le, N. H. (2020). Stacking of SVMs for classifying intangible cultural heritage images. In Advances in intelligent systems and computing (Vol. 1120, pp. 189–200). Springer. https://doi.org/10.1007/978-3-030-38364-0_17.

48. Nyandwi, J. (2023). The Transformer Blueprint: A holistic guide to the Transformer neural network architecture. Deep Learning Revision. https://deeprevision.github.io/posts/001-transformer/.

49. Ostertag, C., & Beurton-Aimar, M. (2020). Using graph neural networks to reconstruct ancient documents. arXiv preprint arXiv:2011.07048. https://arxiv.org/abs/2011.07048.

50. Picollo, M., Cucci, C., Casini, A., & Stefani, L. (2020). Hyper-spectral imaging technique in the cultural heritage field: New possible scenarios. Sensors, 20 (10), 2843. https://doi.org/10.3390/s20102843.

51. Projects – Amsterdam Time Machine. (n.d.). Retrieved March 18, 2025, from https://www.amsterdamtimemachine.nl/nl/category/projects/.

52. PTM. (2019, November 29). La carte archéologique de Paris comprenant l’assemblage des plans 1900 est désormais en ligne ! Paris Time Machine . https://paris-timemachine.huma-num. fr/2019/11/29/carte-archeologique-de-paris/.

53. Puang, Pin-Ch et al., Lin. (2025). Integration of artificial intelligence in art preservation and exhibition spaces. Applied Sciences, 15 (2), 562. https://doi.org/10.3390/app15020562.

54. Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., … & Sutskever, I. (2021). Learning transferable visual models from natural language supervision. In Proceedings of the 38th International Conference on Machine Learning, 139, 8748–8763.

55. Ratan, P. (2020, October 28). What is the Convolutional Neural Network Architecture? Analytics Vidhya. https://www.analyticsvidhya.com/blog/2020/10/what-is-the-convolutional-neural-network-architecture/.

56. Razani, M., Nemani Khiyavi, L., Ranjbari, A., & Amiri, A. (2024). A new reproduction of the Urartian cuneiform inscription of Seqindel, Varzghan, East Azerbaijan, Iran. Language Studies, 15 (1), 57–80. https://doi.org/10.30465/. ls.2023.47346.2164.

57. Razani, M., & Nemani, L. (2024). Analyzing the structural and visual pathology of Urartian inscriptions in Seqindel, Varzeghan, East Azarbaijan, Iran. Athar, 45 (106), 25–46. http://dx.doi.org/10.22034/45.106.2.

58. RePAIR Project. (n.d.). RePAIR Project. Retrieved March 18, 2025, from https://www.repairproject.eu/.

59. Russell, S., & Norvig, P. (2021). Artificial intelligence: A modern approach (4th ed.). Pearson.

60. Shugar, A. N., & Mass, J. L. (Eds.). (2012). Handheld XRF for art and archaeology. Leuven University Press.

61. Smith, E., & Clark, R. J. H. (2020). Raman spectroscopy in art and archaeology. Royal Society of Chemistry.

62. Smith, J., & Lee, R. (2020). Time-series analysis for cultural heritage. Journal of Archaeological Science, 117, 103245. https://doi.org/10.1016/j.jas.2020.103245.

63. Song, S., Yoo, H., Jin, J., Cho, K., & Oh, A. (2025). HERITAGE: An end-to-end web platform for processing Korean historical documents in Hanja. arXiv preprint arXiv:2501.11951.

64. Stublić, H., Bilogrivić, M., & Zlodi, G. (2023). Blockchain and NFTs in the cultural heritage domain: A review of current research topics. Heritage, 6 (4), 2042. https://doi.org/10.3390/heritage6040202.

65. Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction (2nd ed.). MIT Press.

66. The ‘time machine’ reconstructing ancient Venice’s social networks. (n.d.). Nature. Retrieved March 18, 2025, from https://www.nature.com/articles/546341a.

67. The Top AI Trends for 2025 | Gartner Webinars. (n.d.). Gartner. Retrieved March 18, 2025, from https://www.gartner.com/en/webinar/684780/1529507.

68. This AI can spot an art forgery. (n.d.). IEEE Spectrum. Retrieved March 18, 2025, from https://spectrum.ieee.org/this-ai-can-spot-an-art-forgery.

69. Time Machine Europe. (2025, March 26). Time Machine Europe. https://www.timemachine.eu/.

70. Turing, A. M. (1950). Computing machinery and intelligence. Mind, 59 (236), 433–460. https://doi.org/10.1093/mind/LIX.236.433.

71. Unger, A., & Schubert, A. (2020). Image classification for cultural heritage using Random Forest. CEUR Workshop Proceedings.

72. Utilizing BERT for information retrieval: Survey, applications, resources, and challenges. (n.d.). Retrieved March 18, 2025, from https://arxiv.org/html/2403.00784v1.

73. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. In Advances in Neural Information Processing Systems, 30, 5998–6008.

74. Verhagen, P., Nuninger, L., & Lock, G. (2019). Modelling archaeological predictive maps using Random Forests. Journal of Computer Applications in Archaeology, 2 (1), 1–15. https://doi.org/10.5334/jcaa.71.

75. Wang, J., & Chen, Y. (2023). Image restoration using CNNs for cultural heritage. arXiv preprint arXiv:2310.05270.

76. Wang, L., Zhou, M., & Kim, J. (2024). Combining CNNs and Transformers for art classification. arXiv preprint.

77. Wang, Y., & Zhang, L. (2023). An analysis of research trends for using artificial intelligence in cultural heritage. Electronics, 13 (18), 3738. https://doi.org/10.3390/electronics13183738.

78. Wang, Y., & Zhou, Y. (2025). Artificial intelligence-driven interactive experience for intangible cultural heritage: Sustainable innovation of blue clamp-resist dyeing. Sustainability, 17 (3), 898. https://doi.org/10.3390/su17030898.

79. Wang, Y., Liu, J., Wang, W., Chen, J., Yang, X., Sang, L., Wen, Z., & Peng, Q. (2024). Construction of cultural heritage knowledge graph based on graph attention neural network. Applied Sciences, 14 (18), 8231. https://doi.org/10.3390/app14188231.

80. Wang, Z., & Song, H. (2025). A fusion model for artwork identification based on convolutional neural networks and transformers. arXiv preprint arXiv:2502.18083. https://arxiv.org/abs/2502.18083.

81. Wenzel, K., & Müller, M. (2021). Semantic classification of point clouds for cultural heritage applications using Random Forest. Electronics, 13 (18), 3738.

82. Wetzel, W. (2024). What machine learning reveals in the study of pigments in cultural heritage. Spectroscopy Online. Retrieved from https://www.spectroscopyonline.com/view/what-machine-learning-reveals-in-the-study-of-pigments-in-cultural-heritage.

83. Willemsen, M., Opitz, R., & Niven, K. (2020). An explorative application of Random Forest algorithm for archaeological predictive modeling in the Canton of Zurich, Switzerland. Journal of Computer Applications in Archaeology, 3 (1), 89–104. https://doi.org/10.5334/jcaa.71.

84. Yang, I., Ma, W., & Vosoughi, S. (2024). NushuRescue: Revitalization of the endangered Nushu language with AI. arXiv preprint arXiv:2412.00218.

85. Yong, E. (2024, October 21). How scientists started to decode birdsong. The New Yorker. Retrieved from https://www.newyorker.com/ magazine/2024/10/21/how-scientists-started-to-decode-birdsong.

86. Zhang, B., et al. (2023). Can AI-generated art stimulate the sustainability of intangible cultural heritage? A quantitative research on cultural and creative products. PMC, 12 (1), 1–15. https://doi.org/10.1016/j.heliyon.2023.e20477.

87. Zhang, J., Ringle, W., & Willis, A. R. (2024). Unveiling ancient Maya settlements using aerial LiDAR image segmentation. arXiv preprint arXiv:2403.05773 . https://arxiv.org/abs/2403.05773.

88. Zhang, W., Kam-Kwai, W., Xu, B., Ren, Y., Li, Y., Zhu, M., Feng, Y., & Chen, W. (2024). CultiVerse: Towards cross-cultural understanding for paintings with large language model. arXiv preprint arXiv:2405.00435. https://arxiv.org/abs/2405.00435.

89. Zhang, Y., & Patel, M. (2021). Neural networks for ancient text translation. Artificial Intelligence and Cultural Heritage, 8 (3), 175–192.

90. Zhao, Z., & Yang, Y. (2025). Research on Red cultural inheritance and application of SVM (Support Vector Machine) in sentiment analysis. Applied Mathematics and Nonlinear Sciences, 10 (1). https://doi.org/10.2478/amns-2025-0766.

91. Zhu, X., Li, Y., & Chen, W. (2023). Metadata assignment for cultural artifacts using Transformers. arXiv preprint.

Send email to the article author

Rights and permissions
	This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.