Mental Distractions During Meditation

I have recently begun to meditate. I notice that as I get close to the light and the vastness of consciousness, somehow I wish to end the whole thing. Leave and walk away and get on with unimportant things. A sense of fear perhaps or too much freedom. Why would I sit and wait and when it becomes clear, I would want to shut off and leave?