I would look into running a 4 bit quant using llama cpp (or any of its wrappers)

		pixelmelt 23 days ago \| parent \| context \| favorite \| on: GLM-4.7-Flash I would look into running a 4 bit quant using llama cpp (or any of its wrappers)