Scared to Death of Working WHY??

SO i have this thoery that once i start working out i wont be able to stop which is good. But im scared to get thrown off track and never get back on the saddle...So i am stuck? Do i stay or should go forward???