Caffeine is a stimulant to the central nervous system, and regular use of caffeine does cause mild physical dependence. ... If you stop taking caffeine abruptly, you may have symptoms for a day or more, especially if you consume two or more cups of coffee a day. Symptoms of withdrawal from caffeine include: headache.