Hard-Coding Bias in Google “Algorithmic” Search Results

I present categories of searches for which available evidence indicates Google has “hard-coded” its own links to appear at the top of algorithmic search results, and I offer a methodology for detecting certain kinds of tampering by comparing Google results for similar searches. I compare Google’s hard-coded results with Google’s public statements and promises, including a dozen denials but at least one admission. I conclude by analyzing the impact of Google’s tampering on users and competition, and by proposing principles to block Google’s bias.

Details, including screenshots, methodology, proposed regulatory response, and analogues in other industries:

Hard-Coding Bias in Google “Algorithmic” Search Results

What Advertisers Use WhenU?



Advertisers Using WhenU

Ever wonder who advertises on WhenU? A few reporters have tried to figure this out but have been stymied: Few companies care to talk about their use of Claria or WhenU. (WSJ [paid registration required], BusinessWeek).

So I thought I’d put together a list of all of WhenU’s current advertisers — all the companies showing graphical ads (not just sponsored link text) on WhenU’s system. There are 234 distinct advertisers, by my count. The biggest advertisers (by advertisement count) are Priceline (51 ads), J.P. Morgan Chase (43), Casino On Net (37), Verizon (28), Orexis (24). Major advertisement categories:

Gambling, Betting and Bingo 327 advertisements 49 advertisers
Loans 263 advertisements 35 advertisers
Travel 213 advertisements 21 advertisers

Further down the list, 102 ads for insurance, 99 for sexual health (mostly Viagra and similar products) and even some ads for online psychics and online cigarette sales.

All the details, and thousands of advertisement thumbnails, are in:

Advertisers Using WhenU

Sites Blocked by ADL HateFilter with Jonathan Zittrain

Like numerous other Internet filtering programs, the Anti-Defamation League’s HateFilter attempts to prevent users from knowing which specific web sites are deemed off-limits. However, this research presents a method for efficiently determining which specific sites are blocked, and this site reports results. Numerous sites are blocked that no longer offer content meeting ADL’s definitions (if they ever did), including sites now offering other substantive content, sites that offer only error messages, and sites that no longer exist.

Continued: Sites Blocked by ADL HateFilter

Documentation of Gator Advertisements and Targeting

The Gator Corporation designs software to display advertisements on users’ computer screens, triggered in part by the specific web sites users visit. The author has developed an automated method of determining which specific advertisements Gator has associated with which web sites, data that may be helpful to web site operators, policy-makers, and others in assessing Gator’s practices. This article offers listings of more than eight thousand specific sites targeted by Gator as well as analysis of the advertisements shown. An interface is also available to let interested Internet users to test Gator’s advertisements on their own.

Documentation of Gator Advertisements and Targeting

Benjamin Edelman v. N2H2, Inc.

I sought to research and document sites categorized and restricted by Internet blocking program N2H2. N2H2’s block site list is protected by technical measures including an encryption system, but I sought to write software that would nonetheless allow me to access, analyze, and report its contents. However, I feared that conducting this work might expose me to liability for violation of the N2H2 License, of the Copyright Act of 1976, and of the Digital Millennium Copyright Act, as well as for misappropriation of N2H2’s trade secrets. With representation by the ACLU, I therefore sought from federal court a declaratory judgement that I could conduct this research and publication without fear of liability.

Case details including litigation documents

Qualified as expert in Internet filtering over objections from US Department of Justice

In Multnomah County Public Library et al., vs. United States of America, et al. (an ACLU challenge to the Children’s Internet Protection Act), I prepared an expert report, then was offered as an expert for oral testimony.  Counsel for the United States of America challenged my credentials, remarking on my youth and lack of relevant credentials.  The United States’ challenge was overruled.

The voir dire challenge of my designation as an expert:

Q   Mr. Edelman, the highest academic degree that currently hold is a high school diploma, isn’t that correct?

A   That’s correct.

Q   The undergraduate degree that you expect to receive in June of this year is the only undergraduate degree that you will hold when you receive it, isn’t that right?

A   That’s correct.

Q   And that undergraduate degree that you have yet to receive that you will receive in June of 200 will be in economics, is that correct?

A   I will in June of 2002 receive a undergraduate degree in economics, that’s correct.

Q   And you will not receive any degree in computer sciences, is that correct?

A   That’s correct.

Q   You don’t belong to any professional associations currently, is that right?

A   That’s correct.

Q   And you currently hold no professional licenses, is that correct?

A   That’s correct.

Q   You have not published any articles in any scholarly journals, is that correct?

A   That’s correct.

Q   And you have not  published any peer reviewed articles of any kind is that correct?

A   That’s correct.

JUDGE BARTLE:  He may have no peers.

Q   You testified that you spent nine years doing consulting for various organizations, is that right?

A   Yes.

Q   And you began that consulting while you were still in junior high school, isn’t that right?

A   That’s correct.

Q   You currently other than the teaching responsibilities that you have at Harvard College you don’t hold as formal teaching appointment, do you?

A   I do not.

Q   You also testified that you previously given testimony in Federal Court, is that right?

A   Yes.

Q   On one occasion you testified before an Federal District Court, is that correct?

A   That’s correct.

Q   You were not deposed for purposes of that testimony were you?

A   I was not.

BHATTACHARYYA: I render my objection, Your Honors, to the qualifications of this witness as an expert under the Federal Rules of Evidence.

Remarks by the three-judge panel in qualifying me as an expert:

JUDGE BECKER:  Well, I would observe that some of the great figures in history have been autodidacts could spend a half a morning listening to all of the autodidacts.

[Rule] 702 says that it’s scientific technical or otherwise specialized knowledge, assist in the trier of fact to understand the evidence or to determine a fact in issue.  In other words the helpfulness standard.  A witness qualified as an expert by knowledge, skill, experience, training or education may testify thereto in the form of an opinion.  That’s the applicable standard.

I know how I’m prepared to rule. Judge Fullam?

JUDGE FULLAM:  I have two reasons for ruling the same way.  One is that we waited just so we could hear this witness, and I think that would be a terrible waste.

The other is that I happen to on occasion rely upon my six year old grandchild for advice on the internet and computer.

JUDGE BECKER:  Okay.  Ms. Bhattacharyya, your objection is overruled.  Mr. Edelman is qualified to give expert testimony.

Expert Report and Appendices for Multnomah County Public Library et al., vs. United States of America, et al.

I had the honor of testifying, in writing and orally, in Multnomah County Public Library et al., vs. United States of America, et al., an ACLU challenge to the Children’s Internet Protection Act. My expert report, rebuttal report, and supplemental report include documentation of specific pages wrongly blocked by adult filters.

See also my oral testimony including the United States’ attempt to prevent me from being qualified as an expert.