There are many things worse than bergamot... unless you are hypersensitive to citrus rind oil.
Bergamot oil is an oil, so wash with oil-based solvent like white spirit or lacquer thinner. Then isopropylalcohol, acetone or other degreaser to dissolve excess oil-based solvent.