The President leads the Executive Office of the President. The Federal agencies (the Treasury Department, Department of Defense, ...) are themselves led by Cabinet Secretaries nominated by the President and confirmed by the Senate. The Prime Minister appoints Ministers not subject to confirmation by anyone else.

You are about to see how important this confirmation veto is.