Retrieval-Augmented Generation-Based Earth Surface System Association Network Optimization and Data Recommendation

The scientific data of the Earth surface system is characterized by multi-source heterogeneity and dynamic correlation, so constructing an efficient data association network and enabling intelligent knowledge services is a hot topic. Nevertheless, confronted with the existing challenges of onerous data acquisition, inadequate precision of data recommendation, excessive time and labor consumption, as well as insufficient semantic reasoning in intelligent question-and-answer (Q&A) systems, we propose an intelligent framework that integrates dynamic optimization and retrieval-augmented generation (RAG) technology to address the problems of strong subjectivity in the setting of edge weight thresholds in association networks and insufficient semantic inference in intelligent Q&A. First, a multidimensional association network is constructed based on metadata features, redundant edge pruning is achieved through dynamic threshold analysis, and key nodes are identified by combining complex network centrality theory to optimize network structure and storage efficiency. Secondly, the RAG-based intelligent Q&A model is designed to transform the association triples into a paragraph-based knowledge base, generate a domain Q&A dataset using a large language model GPT-4o, and fine-tune the word embedding model to improve the semantic representation accuracy. Experiments show that the number of network edges is reduced by about 70% after optimization, and the node importance analysis accurately identifies key data nodes; the fine-tuned model improves each index by 6% on average in the retrieval task, and the Q&A system significantly outperforms the traditional method in terms of indexes such as relevance and completeness. This study provides innovative solutions for the intelligent service of scientific data in Earth surface systems and promotes the deep integration of association networks and generative AI

Association rule learning · Centrality · Enhanced Data Rates for GSM Evolution · Inference · Metadata · Advanced Graph Neural Networks · Big Data and Digital Economy · Topic Modeling