It could simply be bit serial. With 4 bit weights you only need four serial addi...

		cpldcpu 3 months ago \| parent \| context \| favorite \| on: How Taalas “prints” LLM onto a chip? It could simply be bit serial. With 4 bit weights you only need four serial addition steps, which is not an issue if the weight are stored nearby in a rom.