Yes, the Follow me car IS waiting for you, if you are left behind during the normal following.
However, if you followed it too closely, it will instead "flee" ( with a message the service has been terminated ) so, when it flees, it's goes away faster, and won't wait for you.