The first part of what you say is true. You can be arrested for what silent prayer with no outward sign - in other words for what was going in in your head. It is a thought crime. There are also arrests for reasonable free speech - for example holding up a placard offering to talk to women who were coerced into having an abortion.

The second part is nonsense. Anyone of any religion or none doing the same thing would be committing the same crime. It is perfectly legal to pray in the street except close to a place offering abortions.