dandavis as you said it looks like brownout problem(I never heard before you). To solve it, ordered Lipo batteries, I will test and will inform if it solves.

Because of the led on it seems on and light does not go out.

I used 10k Ohm for pull down resistor