On Route 119 (the route with the weather institute). Start from the weather institute, cross the bridge to the right, and surf down until you find it.
You can also trade Green Shards to a man in a house in the middle of the ocean by Mossdeep for a Leaf stone. 2 Green shards are found through Diving both hidden. All others can be stolen from wild Relicanth.