Clay lanterns can be crafted in the pottery starting from level 58. You'll need candles, oil and tiles for craft.

Clay lanterns can be used to decorate the tree house on your main island