!! History Commons Alert, Exciting News
Profile: Center for Strategic and Budgetary Assessments
Center for Strategic and Budgetary Assessments was a participant or observer in the following events:
Political scientist Timothy Groseclose of UCLA and economist Jeffrey Milyo of the University of Missouri-Columbia release a study entitled “A Measure of Media Bias” that purports to document the “liberal bias” of the mainstream media. Unfortunately for Groseclose and Milyo’s conclusions, their measure of “bias” is found severely wanting, and they fail to mention the substantial body of scholarly work that challenges their theories. The study contains observations of 20 mainstream news outlets, including national newspapers, news magazines, and network and cable television news channels. [Groseclose and Milyo, 12/2004; MSNBC, 12/19/2005; Media Matters, 12/21/2005]
Previous Positions at Conservative Institutions - Groseclose and Milyo have previously received significant funding for their research from three prominent conservative think tanks: the American Enterprise Institute for Public Policy Research (AEI), the Heritage Foundation, and the Hoover Institution on War, Revolution, and Peace. Groseclose has served as a fellow of the Hoover Institution, while Milyo received a $40,500 grant from AEI. Both were named as fellows by the Heritage Foundation. The two authored an article for the conservative American Spectator in 1996.
Flawed Study - Groseclose and Milyo, according to their study, “measure media bias by estimating ideological scores for several major media outlets” based on the frequency with which various think tanks and advocacy organizations were cited approvingly by the media and by members of Congress over a 10-year period. In order to assess media “bias,” the authors assembled the ideological scores given to members of Congress by the liberal group Americans for Democratic Action; examined the floor speeches of selected members to catalog which think tanks and policy organizations were cited by those members; used those citations as the basis for an ideological score assigned to each think tank (organizations cited by liberal members were scored as more liberal, whereas organizations cited by conservative members were scored as more conservative); then performed a content analysis of newspapers and TV programs to catalog which think tanks and policy organizations were quoted. If a news organization quoted a think tank mentioned by conservative members of Congress, then it was said to have a conservative “bias.” The authors write: “As a simplified example, imagine that there were only two think tanks, and suppose that the New York Times cited the first think tank twice as often as the second. Our method asks: What is the estimated ADA score of a member of Congress who exhibits the same frequency (2:1) in his or her speeches? This is the score that our method would assign the New York Times.” The progressive media watchdog organization Media Matters will call the methodology “bizarre,” and will write: “If a member of Congress cites a think tank approvingly, and if that think tank is also cited by a news organization, then the news organization has a ‘bias’ making it an ideological mirror of the member of Congress who cited the think tank. This, as Groseclose and Milyo define it, is what constitutes ‘media bias.’” [Groseclose and Milyo, 12/2004; Media Matters, 12/21/2005] In December 2005, the parent company of the Wall Street Journal, Dow Jones and Co., will question the study’s validity, noting: “[I]ts measure of media bias consists entirely of counting the number of mentions of, or quotes from, various think tanks that the researchers determine to be ‘liberal’ or ‘conservative.‘… And if a think tank is explicitly labeled ‘liberal” or “conservative’ within a story to provide context to readers, that example doesn’t count at all. The researchers simply threw out such mentions.” [Poynter Online, 12/21/2005]
Classifying Organizations - Groseclose and Milyo assign “scores” to a variety of partisan and nonpartisan advocacy groups and think tanks. Some of these scores are problematic:
The National Rifle Association (NRA), widely characterized as a strongly conservative organization, scores a 49.5 on a 100-point scale, classifying it as barely conservative;
The RAND Corporation, a nonprofit research organization closely affiliated with the Defense Department, scores a 60.4, classifying it as strongly liberal;
The Council on Foreign Relations, a nonpartisan political organization featuring both Republicans and Democrats on its board and headed by a former Bush administration official, scores a 60.2, classifying it as solidly liberal;
The American Civil Liberties Union (ACLU), an organization consistently reviled by conservative pundits, scores a 49.8, classifying it as slightly conservative;
The Center for Responsive Politics, a nonpartisan group that tracks political contributions, scores a 66.9, classifying it as highly liberal;
The Center for Strategic and Budgetary Assessments, a defense policy think tank chaired by former Democratic House member Dave McCurdy, scores a 33.9, classifying it as more conservative than AEI and the hard-right National Taxpayers Union.
Lack of 'Balance' Indicates Bias in Study - According to Media Matters, Groseclose and Milyo classify news stories as exhibiting a partisan bias if they fail to balance a “liberal” group’s quote with a “conservative” group’s quote, regardless of the nature of the reporting. For example, the authors cite the National Association for the Advancement of Colored People (NAACP), which they classify as staunchly liberal, as one of the organizations most often quoted without “balancing” quotes from conservative groups. Media Matters will write, “[B]ecause there are no pro-racism groups of any legitimacy (or on Groseclose and Milyo’s list), such stories will be coded as having a ‘liberal bias.’” In contrast, stories featured in the study that quote a spokesperson from the NRA are often “balanced” by quotes from a “liberal” organization, Handgun Control, Inc., though, as Media Matters will note, that organization renamed itself the Brady Campaign to Prevent Gun Violence in 2001, and Groseclose and Milyo do not include that name in their statistics, “therefore, it is impossible to determine from reading the study if Groseclose and Milyo’s score reflects post-2001 citations by legislators and the media of the group under its new name.” Moreover, because the study only assigns partisan weight to quotes from advocacy groups or think tanks, if a story cites a member of Congress as taking a position and contrasts that position with a quote from a think tank, that story, according to the authors, is “biased” in favor of the think tank’s position. Media Matters calls this practice “miscategorization.”
Assuming Reporter, News Outlet Bias - One of the most questionable practices in the study is the assumption that if a reporter quotes a source, that reporter—or his or her news outlet—must believe the opinions expressed by that source. Media Matters will write that “most, if not all, reporters across the ideological spectrum would find [that assumption] utterly ridiculous.” [Groseclose and Milyo, 12/2004; Media Matters, 12/21/2005] The Dow Jones statement will find, “By this logic, a mention of al-Qaeda in a story suggests the newspaper endorses its views, which is obviously not the case.” [Poynter Online, 12/21/2005] The authors say that only two mainstream news outlets, Fox News and the Washington Times, slant rightward. The study finds that Fox News’s coverage is quite moderate; in a 2005 interview on MSNBC, Milyo will say that Fox’s news coverage can be equated with the moderate Republicanism of Senator Olympia Snowe (R-ME), considered the most “liberal”-leaning Republican in Congress. [MSNBC, 12/19/2005]
Bias Findings at Odds with History - The study makes some odd conclusions about liberal bias: for example, the Wall Street Journal, whose op-ed page has long avowed itself as a champion of conservative thought, is characterized by the study as having more “liberal bias” than any news outlet surveyed. The authors claim that they studied only news reporting and not editorial writings, but as Media Matters will note, “the Journal is respected on both the right and the left, and it would be shocking to hear even the most rabid right-winger assert that the Journal is America’s most liberal news outlet.” [Groseclose and Milyo, 12/2004; Media Matters, 12/21/2005]
Methodology Flawed - In December 2005, a spokesman for Dow Jones will call the study “logically suspect and simply baffling.” The statement will note that Groseclose and Milyo only studied four months of Journal reporting, from 2002, while they studied 12 years of CBS News reporting, 11 years of National Public Radio reporting, eight years of reporting from US News and World Report, and two years of reporting from Time Magazine. The Washington Post and Washington Times were also only studied for brief periods. “Yet the researchers provide those findings the same weight as all the others, without bothering to explain that in any meaningful way to the study’s readers,” the statement will note. It will conclude, “Suffice it to say that ‘research’ of this variety would be unlikely to warrant a mention at all in any Wall Street Journal story” (see December 21, 2005).
Failure to Mention Other Studies - The authors fail to mention a large number of previous studies of “media bias.” They do, however, cite three studies that, according to Media Matters, are as “questionable” as this particular study. One assumed that since conservatives say in surveys that the media is biased, then that bias unquestionably exists. The second assumed that news magazines that sold more subscriptions in geographic areas weighted towards Democratic voters were biased in favor of Democrats. The third is an AEI study whose statistics and methodologies were found to be deeply flawed. Groseclose and Milyo ignore one of the most rigorous and exhaustive studies in recent years, a 2000 analysis by the International Communication Association, which found that newspapers and news magazines exhibited little measurable bias, and television network news broadcasts exhibited measurable but relatively insubstantial bias. That study included 59 other studies, all of which go unmentioned in the Groseclose-Milyo study.
Conservative Bibliography - Media Matters will write that the authors seem almost unaware that other studies of media bias exist. The study’s bibliography is heavily freighted with citations from conservative media critics such as Brent Bozell (founder of the Media Research Center) and Reed Irvine (the late founder of Accuracy in Media). The bibliography also cites an article from the hard-right Internet publication WorldNetDaily. It does not cite any entries from dozens of well-known scholarly journals of communication and media studies, most of which have examined the topic of media bias in their pages. [Groseclose and Milyo, 12/2004; Media Matters, 12/21/2005]
Entity Tags: Olympia Snowe, National Public Radio, National Rifle Association, National Taxpayers Union, RAND Corporation, Timothy Groseclose, Time magazine, Washington Times, Reed Irvine, Washington Post, US News and World Report, Wall Street Journal, National Association for the Advancement of Colored People, International Communication Association, Jeffrey Milyo, Brady Campaign to Prevent Gun Violence, Brent Bozell, Americans for Democratic Action, American Civil Liberties Union, American Enterprise Institute, CBS News, Center for Responsive Politics, Center for Strategic and Budgetary Assessments, Hoover Institution on War, Revolution and Peace, Heritage Foundation, Fox News, Dow Jones and Co., Council on Foreign Relations, Media Matters, WorldNetDaily
Timeline Tags: Domestic Propaganda
Receive weekly email updates summarizing what contributors have added to the History Commons database
Developing and maintaining this site is very labor intensive. If you find it useful, please give us a hand and donate what you can.
If you would like to help us with this effort, please contact us. We need help with programming (Java, JDO, mysql, and xml), design, networking, and publicity. If you want to contribute information to this site, click the register link at the top of the page, and start contributing.