How do i generate underwater structures?

I have been reading the wiki trying to figure out how to generate structures underwater. Specifically I want to generate a structure underwater in a deep frozen ocean biome. but I can't seem to find a way to set it to do that.