Why was onnx not part of the tested runtimes? Seems like an oversight | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		timliu9 on June 20, 2024 \| parent \| context \| favorite \| on: Is LMDeploy the Ultimate Solution? Why It Outshine... Why was onnx not part of the tested runtimes? Seems like an oversight

helloericsf on June 20, 2024 | [–]

Personally, I never seen onnx used for LLM.

chaoyu on June 20, 2024 | [–]

onnx is not a good option for LLM type of autoregressive generation

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact