Is it safe to hot glue feathers, gemstones, ribbons, etc. to a lamp shade?

Yes. You are able to hot glue them to the shade just make sure the glue is nice and dry when you put it on. Make sure that when you turn the light on that the glue does not start to melt again.