research methodology

Same Question, Different Answers: How It Happens

How can two studies researching the same question come up with two different answers? That was the dilemma that several media outlets recently had to confront, with the release of the results of two studies looking at the impact of the city of Seattle’s minimum wage ordinance, which raised the minimum wage rate for workers in that city. Even though the studies were looking at the same issue, they came up with results that contradicted each other.

The results of the first study indicated that the wage increase didn’t reduce overall job numbers or hours of work. Media: “Yay! Minimum wage increases are a good thing.” But then the results of the second study indicated that the wage increase caused declines in both numbers of jobs and amounts of work. Media: “Um…okay, maybe minimum wage increases aren’t that great.”

The fact that these studies had different results doesn’t mean that one study is right and the other is wrong, or that both studies are wrong and nobody really knows what happened. The studies are admittedly not easy reading – both use complex forms of economic analysis that, frankly, I wouldn’t try to explain because I would probably get them wrong. But we can still look at how the studies were designed and carried out to see if there are reasons why their results might differ.

Here’s a table that (more…)

How Gender Affects Perceptions of Team Members’ Expertise: The Case of STEM

It’s no secret that women are underrepresented in STEM (science, technology, engineering and mathematics) occupations. There’s several possible reasons for this: not much encouragement for girls or women to take courses in these subjects, lack of visible role models, and lack of support in the workplace. But a set of studies documented in a new article in Administrative Science Quarterly raises another potential problem for women in STEM occupations: gender-related discrimination in co-workers’ evaluations of their expertise.

The three studies described in the article, by Penn State professor Aparna Joshi, looked at (more…)

Flawed Data, Questionable Results: International Monetary Fund Research Gets Criticized

Research methodology scares a lot of people. There’s this idea that you need an advanced degree and very specialized education to design and conduct a research study. That isn’t always true – a lot of times, it’s just a matter of thinking logically about how to get and use meaningful data to help you understand a situation.

But researchers with advanced degrees and very specialized education, and working for hugely influential international policy-making and governance organizations – they know how to collect accurate data and analyze it appropriately. Right? Right??

Ummm….maybe not.

In March of this year, (more…)