About

The purpose of my research is to help people collaboratively build insight around public policy concerns. In practice, I develop and evaluate public engagement technology through controlled experiments and in-the-wild studies, and then synthesize what people convey during system design research into policy analysis and recommendations. As a guide for my system design research, I draw from theory about how groups socialize their members and deliberate policy issues.

Currently I am a postdoctoral researcher at the Protolab and the Design Lab at UC San Diego. I earned my PhD in Information Science from Cornell University. Prior to joining Cornell, I worked at the RAND Corporation, where I was fortunate to have exceptional mentors and encouraged to study a wide range of public policy issues—from the design of youth summer learning programs to predictive policing techniques.

Research

How Features of a Civic Design Competition Influence the Collective Understanding of a Problem
Brian McInnis, Xiaotong (Tone) Xu, Steven Dow

Organizations often strive to build a shared understanding about complex problems. Design competitions provide a compelling approach to create incentives and infrastructure for gathering insights about a problem-space. In this paper, we present an analysis of a two-month civic design competition focused on transportation challenges in a major US city. We examine how the event structure, discussion platform, and participant interactions affected how a community collectively discussed design constraints and proposals.

Crafting Policy Discussion Prompts as a Task for Newcomers
Brian McInnis, Gilly Leshed, Dan Cosley

Inspired by policy deliberation methods and iterative writing in crowdsourcing, we developed and evaluated a task in which newcomers to an online policy discussion, before entering the discussion, generate prompts that encourage existing commenters to engage with each other. In an experiment with 453 Amazon Mechanical Turk (AMT) crowd workers, we found that newcomers can often craft acceptable prompts, especially when given guidance on prompt-writing and balanced opinions between the comments they synthesize.

Effects of Comment Curation and Opposition on Coherence in Online Policy Discussion
Brian McInnis, Dan Cosley, Eric Baumer, Gilly Leshed

Public concern related to a policy may span a range of topics. As a result, policy discussions struggle to deeply examine any one topic before moving to the next. In policy deliberation research, this is referred to as a problem of topical coherence. In an experiment, we curated the comments in a policy discussion to prioritize arguments for or against a policy proposal, and examined how this curation and participants’ initial positions of support or opposition to the policy affected the coherence of their contributions to existing topics.

Taking a HIT: Designing around Rejection, Mistrust, Risk, and Workers' Experiences in Amazon Mechanical Turk
Brian McInnis, Dan Cosley, Chaebong Nam, Gilly Leshed

Online crowd labor markets often address issues of risk and mistrust between employers and employees from the employers’ perspective, but less often from that of employees. Based on 437 comments posted by crowd workers (Turkers) on the Amazon Mechanical Turk (AMT) participation agreement, we identified work rejection as a major risk that Turkers experience. We argue that making reducing risk and building trust a first-class design goal can lead to solutions that improve outcomes around rejected work for all parties in online labor markets.

Running user studies with crowd workers
Brian McInnis, Gilly Leshed

Crowd work platforms are becoming popular among researchers in HCI and other fields for social, behavioral, and user experience studies. Platforms like Amazon Mechanical Turk (AMT) connect researchers, who set the studies up as tasks or jobs, to crowd workers recruited to complete the tasks for payment. We report on the lessons we learned about conducting research with crowd workers while running a behavioral experiment in AMT.

One and Done: Factors affecting one-time contributors to ad-hoc online communities
Brian McInnis, Elizabeth Murnane, Dmitry Epstein, Dan Cosley, Gilly Leshed

Often, attention to "community" focuses on motivating core members or helping newcomers become regulars. However, much of the traffic to online communities comes from people who visit only briefly. We hypothesize that their personal characteristics, design elements of the site, and others' activity all affect the contributions these “one-timers” make. We present the results from an experiment asking Amazon Mechanical Turk ("AMT") workers to comment on the AMT participation agreement in a discussion forum.

Hiking

Here are a few of the spots I am enjoying at the moment.

Taughannock Falls, New York State Park
add_location
Taughannock Falls
New York State Park

Climb the North Rim trail to the top of the park, then return along the South Rim with beautiful views into this glacier carved gorge.

Watkins Glen, New York State Park
add_location
Watkins Glen
New York State Park

The best time to visit is on a dark and stormy day to avoid the lines of people. Take the Gorge Trail to Rainbow Falls and back on Lover's Lane.