Well, you can actually, but you can't follow just by submitting your email id and pressing a 'subscribe' button.
Is there an app to do that? Wait, I shall have to search. This is a strange machine.
You should be able to 'subscribe' to a Shopify just by submitting your email id. Why not! Let me see.