Ask HN: Why are desktop AI apps so heavy?

I mean they are text apps basically, they should be flying on modern PCs that can do close to a trillion ops per second. Inference is done elsewhere, so what's the deal?