I've had better results running it with the Gemini 2.5 Pro model but it's much more expensive. The website is using the very cheap 2.5 flash lite model.

You can run it yourself using the better model to see if you get better results as well:

https://github.com/montanaflynn/asxiv