You need to smash large stones. You can also get emeralds for completing chains of orders from the merchant.

This resource can be used to complete the shaman’s orders and to repair or upgrade buildings and objects.
Note: emeralds, like the other items from the "Rare" section of storage, don't take up any space in storage, so you don't need to worry about their quantity.