The authors are studying exclusions from search engine search results, and have found some 113 sites excluded, in whole or in part, from the French google.fr and German google.de compared with google.com. Learn more about the situation and context, test the exclusions for yourself, and submit further sites suspected to be excluded. Full article.
TLD Registration Enforcement: A Call for Automation
TLD Registration Enforcement: A Call for Automation – Part I and Part II. CircleID. (September – October 2002)
Replacement of Google with Alternative Search Systems in China: Documentation and Screen Shots with Jonathan Zittrain
The authors are studying Internet filtering in countries worldwide, and current investigations focus on restrictions on web access in China. Using a web-based system to test web filtering in China, the authors previously determined and confirmed that Google was inaccessible from at least one testing location in China; initially, in testing beginning August 29, a request for Google led to the error “host not found,” consistent with requests for other inaccessible or blocked sites. However, using related methods, the authors have now confirmed and documented reports that Chinese Internet access currently provides pages other than the ordinary Google home page in response to requests for google.com; such behavior is believed to have begun on September 8. The screen shots in this article document six instances of this replacement. Full article.
iCravetv.biz and Entervision Retransmit CNN, Cartoon Network, PAX TV, California NBC Affiliate
I found that iCravetv.biz and Entervision retransmitted CNN, Cartoon Network, PAX TV, and a California NBC Affiliate — an urgent concern in light of contemporaneous disputes about video retransmission. Details and screenshots.
Survey of Domain Registration Services – Initial Results
Survey of Domain Registration Services. (August – November 2003)
Numerous competitive registrars offer diverse domain registration services to individuals, companies, and organizations. This site attempts to index and analyze their service offerings, facilitating analysis by other researchers and in preparation for additional analysis by the author.
Interested registrars have completed a survey of service offerings, and this page summarizes results. Surveys remain available for those additional registrars who care to submit information about their services.
Survey of Usage of the .US TLD
Survey of Usage of the .US TLD. (August – September 2002)
Recent policy changes allow registrations in .US with few restrictions. The author collects data about all known .US registrations, analyzing their registration patterns and usage. Certain registrants are found to register more than 2,000 domains each; these registrants may be gathering domains for commercial applications requiring many domains or for future sale, and large registrants (with ten or more .US domains) jointly hold a total of 46.4% of .US registrations to date. Non-Americans are found to register 7.0% of domains, and some of these registrations may violate .US registration restrictions that require nexus in the United States. The overwhelming majority of .US registrations as yet provide no original web content; working .US web sites are found to be clustered with certain registrars, while certain other registrars tend to register domains that offer no web content and domains offered for resale.
Registrations in Open ccTLDs
Registrations in Open ccTLDs. (June – July 2002)
The author analyzes domain registrations and usage in the “open ccTLDs” of .CC, .TV, and .WS in order to quantify the domains’ size, usage, and registration patterns. Analysis first reports the number of open ccTLD web pages indexed by Google, finding open ccTLDs to be less than one one-hundredth as large as .COM when measured in this way. The author next considers registration of commonly-used dictionary nouns; while many such domains have been registered in the tested ccTLDs, more than 80% lead only to placeholders or to no web content at all. Finally, the author investigates open ccTLD registrations that use the same second-level strings as the primary .COM domains of major corporations worldwide (including the Fortune 1000 and Forbes International 500). Again, many such domains have been registered, and more than two thirds of such registrations are by registrants other than the registrant of the corresponding .COM. The web content available on sampled domains provides evidence both of substantial defensive registrations and of substantial cybersquatting.
DNS as a Search Engine: A Quantitative Evaluation
DNS as a Search Engine: A Quantitative Evaluation. (June – July 2002)
In the course of the Internet’s growing popularity, many Internet users have come to use the domain name system (DNS) as a directory and search engine: When trying to reach the web site of a new or unknown company, users often request the web page at the address http://www.companyname.com, replacing “companyname” with a guess as to a site’s likely domain name. However, this DNS-based method is imperfect in that users may fail to correctly guess or remember a given company’s domain name, instead typically receiving errors or sites operated by other entities.
The research described in this article suggests that alternative search mechanisms, such as leading search engine Google, provide the content of interest with greater accuracy and reliability than does the DNS. This finding supports the claim offered by, among others, DNS software designer Paul Vixie, that DNS “is not a directory service and was never intended to be used as one.” This finding also quantifies Dan Gillmor‘s “Google effect” whereby Google replaces DNS as the preferred mechanism of locating content online.
Research further suggests that, while DNS offers what some might consider relatively high accuracy when conducting searches for top brands, companies, and organizations, DNS is substantially less accurate in searches for smaller brands, companies, and organizations.
Survey of Usage of the .BIZ TLD
Survey of Usage of the .BIZ TLD. (June 2002) With Jonathan Zittrain.
The authors examined a variety of data about registrations in .BIZ. Analysis suggests that at least 74% of currently registered .BIZ domains provide no web content or provide only error messages or placeholders. Using WHOIS data, we conclude that approximately 25% of .BIZ registrations are registered to the same organization that registered the corresponding .COM, and that such domains are about one-third less likely to provide substantive web content than domains registered by someone without a corresponding .COM registration. We document 4886 distinct .BIZ domains seemingly inconsistent with .BIZ registry anti-warehousing policies, suggesting that such policies are not being effectively enforced. Finally, we compare .BIZ registrar market shares with corresponding shares in .COM, .NET, and .ORG, and we summarize notable differences in registrar market share across TLDs.
Alternative Perspectives on Registrar Market Share: The Fortune 1000, the Forbes International 500, and the Yahoo Directory
Since the 1999 introduction of competitive registration of domain names, analysts have examined the market share of the various registrars now able to offer registrations in the gTLDs of .COM, .NET, and .ORG. Initially Network Solutions (subsequently bought by Verisign) served the entire market as the sole supplier of such domain names, but competitive registrars have subsequently come to have substantial market share. Understanding registrar market share is of interest in assessing the financial viability and proper valuation of each registrar, in selecting a registrar, and in understanding the registrar features and design seemingly of greatest interest to domain registrants.
Continued work by State of the Domain (among others) documents registrar market share as measured as a proportion of total COM, NET, and ORG domain names. In contrast, the work described in this document takes a different perspective, focusing instead on certain subsets of the domain registration market. In particular, this work considers the domains of the largest American firms (as listed in the Fortune 1000), the largest firms worldwide (as listed in the Forbes International 500), and the relatively well-known sites listed in leading web directory Yahoo. These subsets of the gTLD domain name space are of interest for the distinct registration markets they represent. Most notably, this analysis focuses on domains actually in active use; the design of these subsets seeks to exclude domain name speculators and warehousers, whose millions of domain registrations might prevent ordinary domain registration analysis from properly reflecting the registrations of all domains actually in current active use and most likely to be renewed in the future.
Analysis shows substantial divergence among the groups studied. For example, while Verisign’s market share across all COM, NET, and ORG registrations has fallen to 39.1%, its market share among the primary domains of Fortune 1000 companies remains 83.4%. Similarly, while 74.1% of domains in a 2001 snapshot of Yahoo are currently registered with Verisign, only 44.8% of recent additions to Yahoo use Verisign. Nonetheless, Verisign’s market share is in every category of domains found to be larger than SOTD reports; thus, excluding registrations by domain speculators and warehousers, it is likely that Verisign has a larger market share — of domains actually in use — than SOTD’s analysis has suggested. In the Results section of this document, similar data is provided for a variety of other registrars.
In this research, I document the registrars used by each of the Fortune 1000 companies, by each of the Forbes International 500 companies, and by each listing in Yahoo; I subsequently compare these registration patterns with the registrars used by the entire domain name registration market.