Oriel — AI & technology worth noticing, every day.

MNN: A Universal and Efficient Inference Engine

Paper · https://arxiv.org/abs/2002.12418

Deploying deep learning models on mobile devices draws more and more attention recently. However, designing an efficient inference engine on devices is under the great challenges of model compatibility, device diversity, and resource limitation. To deal with these challenges, we propose Mobile Neural Network (MNN), a universal and efficient inference engine tailored to mobile applications. In this paper, the contributions of MNN include: (1) presenting a mechanism called pre-inference that manages to conduct runtime optimization; (2)deliveringthorough kernel optimization on operators to achieve optimal computation performance; (3) introducing backend abstraction module which enables hybrid scheduling and keeps the engine lightweight. Extensive benchmark experiments demonstrate that MNN performs favorably against other popular lightweight deep learning frameworks. MNN is available to public at: https://github.com/alibaba/MNN.

First seen by Oriel on .

No saved summary available.

Metric trends

Last 30 days · Up to 120 recorded samples per source and metric, with reposts kept separate · First and latest retained

Points

Score reported by the source.

  • Hugging Face Papers: 0, latest observation ; 0 over observed period since

Comments

Comment count reported by the source.

  • Hugging Face Papers: 0, latest observation ; 0 over observed period since

Aliases

SourceExternal IDURL
Hugging Face Papers2002.12418https://arxiv.org/abs/2002.12418 Read discussion