In perl ? HTML::SimpleLinkExtor open source. But recursing a whole domain would require some serious scripting ...