Something that is "frivolous" to you is a passion or even a profession for others. Competitive gaming is a massive market worldwide, and it wouldn't exist without the ability to enforce a level playing field. Not everything has to be a holy FOSS war.
Do you use a separate user to play games? If not it's kinda useless as a user space process can read all your files and memory of running processes of the same user.