I actually ventured down to Shimoda to see this festival and I can whole-heartedly recommend it. There are hundreds of thousands of hydrangea plants for you to see.
Where: Shimoda Park
Access: Go to Izu-kyu Shimoda Station. It is about a 15 minute walk from the station.
When: All of June, but the area is still pretty in July!