You can get paper lanterns by crafting paper, a candle, glue, and either red, green, blue, or purple dye.
