Posted by Dave Sifry:
When you wrote, “they don’t necessarily conflate different URLs on the same site”, I’m not sure I understood your criticism. Technorati will list all of the people linking to URLs that are at or below the URL you provide. In other words, if you put in “http://www.sifry.com/”, it will show you everyone it its database who is linking to http://www.sifry.com/, http://www.sifry.com/alerts/, and http://www.sifry.com/alerts/foo.html.
The more specific the URL you put in, the more specific Technorati’s response will be. The major flaw is for sites that sometimes use the “www” prefix and sometimes do not – occasionally, Technorati sees that as two blogs. So it thinks that http://www.boingboing.net/ and http://boingboing.net are different, and you need to do two queries to get all the links. This is a tough problem, because there exist counterexamples of people who use different domain name prefixies to refer to different parts of their site, like http://alerts.sifry.com/, which simply redirect to http://www.sifry.com/alerts/
-Dave (david@sifry.com)