Except that the most glaring difference is that compilers are deterministic, while LLMs aren't.

Given the same input, compilers will always return the same output, while for LLMs. They won't, given the same input, they will return different output.