Skip to main content

ETHNOS_APP

Home • Search • Journals • List 0

AltarData

A novel annotated dataset for object detection in the Brazilian heritage altars using deep learning

Bibliographic Data

ID24031843
AuthorsAndré Luiz Carvalho Ottoni (0000-0003-2136-9870, Universidade Federal dos Vales do Jequitinhonha e Mucuri, corresponding author), Lara Toledo Cordeiro Ottoni (0000-0003-3996-431X, Universidade Federal dos Vales do Jequitinhonha e Mucuri)
Year2026
Volume81
Pages248-259
Publication date2026-09-01
Open AccessYes
TypeARTICLE
VenueJournal of Cultural Heritage (JOURNAL)
Journal identifiersISSN: 1296-2074 • E-ISSN: 1778-3674
PublisherElsevier BV (PUBLISHER)
DOI10.1016/j.culher.2026.07.024
OpenAlexW7202361821
LanguageEN
References cited40

The evolution of machine learning techniques has enabled significant advances in the field of object detection using computer vision applied to historical buildings. Indeed, studies in this area can contribute to applications ranging from automatic digital documentation to the technological enhancement of inspections in cultural heritage sites. However, a recurring challenge lies in the quality and public availability of image datasets that enable the application of deep learning models in the context of heritage churches, particularly those focused on the interior environments of these religious buildings. In this context, the objective of this paper is to present a novel annotated dataset for object detection in Brazilian heritage altars using deep learning. The proposed dataset, named AltarData, comprises 1278 high-quality images collected from 33 churches located in 12 historical cities in Brazil. Three of these urban ensembles are recognized as UNESCO World Heritage Sites: the Historic Town of Ouro Preto, the Historic Centre of Salvador de Bahia, and the Historic Centre of the Town of Diamantina. The data were carefully annotated, resulting in 12,093 labeled instances across six categories frequently found in Baroque and Rococo heritage altars: altar table, column, crucifix, saint sculpture, tabernacle, and throne. In addition, a deep learning with hyperparameter tuning approach was proposed, enabling the optimization of object recognition in heritage altars, achieving validation accuracies of up to 92.0% (altar table), 87.1% (column), 72.2% (crucifix), 85.1% (saint sculpture), 97.3% (tabernacle), and 84.7% (throne). In the test experiments, an F1-score of 79% was achieved using the MobileNetV2 configuration with width multiplier 0.35 and learning rate 0.0100. Overall, this paper contributes to the research field of new datasets for deep learning in cultural heritage sites, fostering advances in multi-object recognition within the interior environments of historical churches.

Cultural heritage · Deep learning · Object (grammar) · Object detection · Pattern recognition (psychology) · 3D Surveying and Cultural Heritage · Advanced Image and Video Retrieval Techniques · Image Processing and 3D Reconstruction

  • Interactive multilevel digital database for the preventive conservation and documentation of heritage structures

    Open Access•Elena López-Ortiz, Iván García‐Jiménez et al.•Journal of Cultural Heritage•2026

  • Deep learning techniques for crack detection in St. Theodore Church, Cappadocia

    Open Access•Ahmet Kilic, Şerife Özata et al.•Journal of Cultural Heritage•2026

  • The Classification of Cultural Heritage Buildings in Athens Using Deep Learning Techniques

    Open Access•Konstantina Siountri, Christos‐Nikolaos Anagnostopoulos•Heritage•2023

  • ImageOP

    Open Access•André Luiz Carvalho Ottoni, Lara Toledo Cordeiro Ottoni•Heritage•2024

  • Artificial Intelligence at the Interface between Cultural Heritage and Photography

    Open Access•Carmen Lucia Souza da Silva, Lídia Oliveira•Heritage•2024

  • DEArt

    Open Access•Artem Reshetnikov, Maria-Cristina Marinescu et al.•Journal of Cultural Heritage•2025

  • A deep learning approach for cultural heritage building classification using transfer learning and data augmentation

    Open Access•André Luiz Carvalho Ottoni, Lara Toledo Cordeiro Ottoni•Journal of Cultural Heritage•2025

  • D damage imaging of Carrara marble sculptures by acoustic tomography coupled to photogrammetry

    Open Access•Marie-Laure Chavazas, Jérémie Berthonneau et al.•Journal of Cultural Heritage•2025

  • Automatic generation of synthetic heritage point clouds

    Open Access•Carlo Battini, Umberto Ferretti et al.•Journal of Cultural Heritage•2023

  • Systematization proposal for the analysis of columns from point clouds

    Open Access•Agustí Costa-Jover, Amparo Núñez Andrés et al.•Journal of Cultural Heritage•2024

  • Multiband photogrammetry for multispectral 3D reconstruction of statuary

    Open Access•Daniele Ferdani, Cristiana Barandoni et al.•Journal of Cultural Heritage•2025

  • New AI challenges for cultural heritage protection

    Open Access•Francesco Colace, Rosario Gaeta et al.•Journal of Cultural Heritage•2025

  • D imaging of the Bayeux Tapestry using photogrammetry and integration into virtual reality

    Open Access•Stéphane Le Mouélic, Clémentine Paquier-Berthelot et al.•Journal of Cultural Heritage•2024

  • A multi-scale stratigraphic HBIM-GIS method for the characterization of structures in heritage sites

    Open Access•Elena López-Ortiz, Iván García‐Jiménez et al.•Journal of Cultural Heritage•2025

  • Automated analysis of Slavic buried settlements based on LiDAR point cloud, UAV and image processing

    Open Access•Klaudia Pasternak, Anna Fryskowska et al.•Journal of Cultural Heritage•2025

  • Artificial intelligence-assisted visual inspection for cultural heritage

    Open Access•M Mishra, Paulo B Lourenço•Journal of Cultural Heritage•2024

  • Understanding architectural heritage

    Open Access•Ming Guo, Li Zhu et al.•Journal of Cultural Heritage•2025

  • Archaeological site segmentation of ancient city walls based on deep learning and LiDAR remote sensing

    Open Access•Shunli Wang, Qingwu Hu et al.•Journal of Cultural Heritage•2024

  • Deep learning-based automated tile defect detection system for Portuguese cultural heritage buildings

    Open Access•Nastaran Karimi, M Mishra et al.•Journal of Cultural Heritage•2024

  • D/3D data fusion for the comparative analysis of the vaults of Notre-Dame de Paris before and after the fire

    Open Access•El Mustapha Mouaddib, Anthony Pamart et al.•Journal of Cultural Heritage•2024

  • CNN-based statistics and location estimation of missing components in routine inspection of historic buildings

    Open Access•Zheng Zou, Xuefeng Zhao et al.•Journal of Cultural Heritage•2019

  • MSD-Det

    Open Access•L Long, Zhenkun Gan et al.•Journal of Cultural Heritage•2025

Highly citedNo

Tools

Open DOIOpen Access
Ethnos_APP • Open Source Project • MIT License • Frontend v2.0.0 • Privacy and Cookies • API Documentation: api.ethnos.app/docs • API Source Code: GitHub • DOI: 10.5281/zenodo.17049435 • Frontend Source Code: GitHub • DOI: 10.5281/zenodo.17050053 • cruz.rio.br • Expectantes Misericordiae