Here's a paper on agent architectures including multi agent. A bit old at this point, but a good overview.

https://arxiv.org/abs/2404.11584