(Conference Paper) Auto-Split: A General Framework of Collaborative Edge-Cloud AI
Amin Banitalebi-Dehkordi ¹, Naveen Vedula ¹, Jian Pei 裴健 ², Fei Xia ³, Lanjun Wang ¹, Yong Zhang ¹
¹ Huawei Technologies Canada Co. Ltd. Vancouver, Canada
² School of Computing Science, Simon Fraser University, Vancouver, Canada
³ Huawei Technologies, Shenzhen, China
中国 深圳 华为技术有限公司
KDD '21: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, 2021-08-14
Abstract
In many industry scale applications, large and resource consuming machine learning models reside in powerful cloud servers. At the same time, large amounts of input data are collected at the edge of cloud. The inference results are also communicated to users or passed to downstream tasks at the edge. The edge often consists of a large number of low-power devices. It is a big challenge to design industry products to support sophisticated deep model deployment and conduct model inference in an efficient manner so that the model accuracy remains high and the end-to-end latency is kept low.
This paper describes the techniques and engineering practice behind Auto-Split, an edge-cloud collaborative prototype of Huawei Cloud. This patented technology is already validated on selected applications, is on its way for broader systematic edge-cloud application integration, and is being made available for public use as an automated pipeline service for end-to-end cloud-edge collaborative intelligence deployment. To the best of our knowledge, there is no existing industry product that provides the capability of Deep Neural Network (DNN) splitting.
High-resolution tumor marker detection based on microwave photonics demodulated dual wavelength fiber laser sensor
Jie Hu, Weihao Lin, Liyang Shao, Chenlong Xue, Fang Zhao, Dongrui Xiao, Yang Ran, Yue Meng, Panpan He, Zhiguang Yu, Jinna Chen, Perry Ping Shum
Opto-Electronic Advances
2024-12-16
Ultra-high-Q photonic crystal nanobeam cavity for etchless lithium niobate on insulator (LNOI) platform
Zhi Jiang, Cizhe Fang, Xu Ran, Yu Gao, Ruiqing Wang, Jianguo Wang, Danyang Yao, Xuetao Gan, Yan Liu, Yue Hao, Genquan Han
Opto-Electronic Advances
2024-10-31