A person should avoid caffeine, which may worsen insomnia. There are several precautions to take while on prednisone: Take prednisone with food to prevent stomach upset. ... Avoid stimulants such as caffeine because these can worsen insomnia, a side effect of prednisone.