Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The new AMD chips in the Framework laptops would be a good candidate and I think you can get 96GB RAM in them. Also if the LLM software is idle (like llama.cpp or ollama) there is negligible extra power consumption.


I preordered a Framework Desktop with 128GB RAM for exactly this reason. Apparently under Linux it's possible to assign >100GB to the GPU.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: