According to the Mayo Clinic, if you are diagnosed with ICP, your doctor may recommend taking a prescription medication, such as ursodiol, to relieve the itching and to decrease the absorption of bile, using anti-itch creams that contain corticosteroids or soaking your skin in lukewarm water.