Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

metal backend 下,同一个模型多次推理,输入的shape不同的情况下,会慢,如何处理。(相同shape,只要预热执行一次推理,第二次会变快) #3156

Open
xiangyuanzhi opened this issue Jan 8, 2025 · 1 comment
Labels

Comments

@xiangyuanzhi
Copy link

平台(如果交叉编译请再附上交叉编译目标平台):

Platform(Include target platform as well if cross-compiling):

MacOS 13.0.1 (apple m1)

Github版本:

Github Version:

MNN 3.0.1

编译方式:

Compiling Method

mkdir build && cd build && cmake .. -DMNN_METAL && make -j8

疑问点

metal backend 下,相同的输入shape,只要预热执行一次推理,第二次会变快。
但是如果输入shape变化了,就会慢,这种情况该如何处理。

@jxt1234 jxt1234 added the Metal label Jan 9, 2025
@sangenan
Copy link

同样遇到该问题,请问计划啥时候修复?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants