Runyue Li

• Efficient Inference Scheduling With Edge and Cloud Collaboration for LLMs Under Resource Constraints

  Yan Wang, Yue Wang et al.

  Incluir item

  Large language models (LLMs) have transformed artificial intelligence (AI) applications but require substantial computational resources, posing challenges for real-time deployment. Cloud computing offers powerful resources but suffers from high latency and bandwidth costs. In contrast, edge computing reduces latency but is limited by its computational capacity for large-scale models. Consequently, edge–cloud collaboration emerges as a critical ap…

• Efficient Inference Scheduling With Edge and Cloud Collaboration for LLMs Under Resource Constraints

  Yan Wang, Yue Wang et al.

  Incluir item

  Large language models (LLMs) have transformed artificial intelligence (AI) applications but require substantial computational resources, posing challenges for real-time deployment. Cloud computing offers powerful resources but suffers from high latency and bandwidth costs. In contrast, edge computing reduces latency but is limited by its computational capacity for large-scale models. Consequently, edge–cloud collaboration emerges as a critical ap…

Cloud computing (1 obra) · Cloud Computing and Resource Management (1 obra) · Distributed and Parallel Computing Systems (1 obra) · Edge computing (1 obra) · Enhanced Data Rates for GSM Evolution (1 obra) · Inference (1 obra) · IoT and Edge/Fog Computing (1 obra)