Carnegie Mellon University

Human-AI Teaming for Decision-Making

Invitation-Only Workshop - September 25-27, 2024

drone_2000x1124-min.jpg

In the last decades and most notably in recent years, we have witnessed significant advancements in what machine AI can do to change human lives.  Machine Learning techniques and availability of large datasets, coupled with potential of learning from human responses, have advanced the possibility to predict complicated patterns of human behavior and generated novel content with human-like characteristics.  However, the basic understanding of how these algorithms can or should interact with humans to generate global social good is unclear.  The interaction of humans and AI can result in improved collaborative decisions and significant benefits to humanity, but it can also result in a significant number of problems and dilemmas, such as privacy concerns, ethical issues including discrimination and bias, safety and cybersecurity concerns, misinformation and disinformation, and many other issues.

The goal of this workshop is to engage in an interdisciplinary exchange of ideas that can move forward the state of the art on Human-AI Interactions as they pertain to improved decision making for the benefit of society. This workshop will bring together leading researchers around human-AI complementarity for decision-making.

The NSF AI Institute for Societal Decision Making (AI-SDM) will sponsor the participation of selected speakers representing multiple disciplines: decision science, cognitive science, computer science, machine learning and others. The workshop will bring together researchers and practitioners in the areas of disaster management and public health resource allocation for the benefit of society. Both applied areas are the central focus of AI-SDM.

AI-SDM Logo NSF Logo

Venue

The workshop will take place September 25-27, 2024 at the Oaklander Hotel, located 0.5 miles from Carnegie Mellon University.   Workshop activities will begin each day in The William Room (10th floor) at the Oaklander, 5130 Bigelow Blvd Pittsburgh, PA 15213.

oaklander.jpg
Workshop Agenda
A welcome reception and dinner will take place Wednesday September 25th, from 6-8pm in the Charles Room (10th floor) at The Oaklander Hotel, 5130 Bigelow Blvd, Pittsburgh, PA 15213.  Workshop activities on Thursday will take place from 8:30am to 5:15pm, with a dinner at Butterjoint, 208 N Craig St, Pittsburgh, PA 15213.  The workshop will continue on Friday from 8:30am to 4:00pm.
Wednesday
September 25th
Thursday
September 26th
Friday
September 27th
Breakfast
8:30-9:00
The William Room, Oaklander Hotel
8:30-9:00
The William Room, Oaklander Hotel
8:30-9:00
Introduction
9:00-9:30

Introductions and Goals
Coty Gonzalez & Aarti Singh
9:00-9:30
Overview and Goal Setting
Coty Gonzalez & Aarti Singh
9:00-9:30
Morning Session A

Session 1: Complementarity for Decision-Making
9:30-10:30

10 minute presentations
Michael Lee
Ido Erev
Sudeep Bhatia
Beau Schelble

20 minute discussion
Chair: Hoda Heidari
Parallel Brainstorm Discussion Groups
9:30-10:30

Group 1: Complementarity for Decision-Making
Led by Hoda Heidari - The William Room, Side A

Group 2: Autonomous and Cognitive Models of Decision-Making
Led by Paul LehnerThe Charles Room

Group 3: Influencing Decision-Making Behavior
Led by Bryan WilderThe Henry Room

Group 4: Trust, Metrics, and Evaluations
Led by Aarti SinghThe George Boardroom

Group 5: Hybrid Systems at the Societal Scale
Led by Robin MurphyThe William Room, Side B
Coffee Break
10:30-11:00
The William Room, Oaklander Hotel
10:30-11:00
The William Room, Oaklander Hotel
10:30-11:00
Morning Session B

Session 2: Autonomous and Cognitive Models of Decision-Making
11:00-12:00

10 minute presentations
Kate Donahue
Christian Lebiere
Mark Steyvers
Jeff Schneider


20 minute discussion
Chair: Paul Lehner
Brainstorm Discussion Groups (continued)
11:00-12:00

Group 1: Complementarity for Decision-Making
Led by Hoda Heidari - The William Room, Side A

Group 2: Autonomous and Cognitive Models of Decision-Making
Led by Paul Lehner - The Charles Room

Group 3: Influencing Decision-Making Behavior
Led by Bryan WilderThe Henry Room

Group 4: Trust, Metrics, and Evaluations
Led by Aarti SinghThe George Boardroom

Group 5: Hybrid Systems at the Societal Scale
Led by Robin MurphyThe William Room, Side B
Lunch
12:00-1:00
The William Room, Oaklander Hotel
12:00-1:00
The William Room, Oaklander Hotel
12:00-1:00
Afternoon Session A

Session 3: Influencing Decision-Making Behavior
1:00-2:00

10 minute presentations
Fei Fang
Gloria Washington
Manish Raghavan

Hirokazu Shirado

20 minute discussion
Chair: Bryan Wilder
Chair Summaries and Cross-Session Input
The William Room
1:00-3:00

10 minute summary by Session Chairs followed by 10 minute Q&A
Hoda Heidari
Paul Lehner
Bryan Wilder
Aarti Singh
Robin Murphy
Coffee Break
2:00-2:30
The William Room, Oaklander Hotel
2:00-2:30
The William Room, Oaklander Hotel
2:00-2:30
Afternoon Session B

Session 4: Trust, Metrics, and Evaluations
2:30-3:30

10 minute presentations
Terri Adams-Fuller
Dan Goldstein
Erin Chiou
Chris Myers


20 minute discussion
Chair: Aarti Singh
Writing and Delivery of Outputs to Coty/Aarti
3:00-4:00




Coffee Break
3:30-4:00
The William Room, Oaklander Hotel
3:30-4:00
The William Room, Oaklander Hotel
3:30-4:00
Afternoon Session C
Session 5: Hybrid Systems at the Societal Scale
4:00-5:00

10 minute presentations
Anita Woolley
Francis Alexander
Mohammad Jalali
Nancy Cooke

20 minute discussion
Chair: Robin Murphy

Conclusions and Plan for Day 2
Coty Gonzalez & Aarti Singh
5:00-5:15
Departure
Dinner
Welcome Dinner at The Oaklander Hotel
Charles Room (10th Floor)
6:00-8:00

5130 Bigelow Blvd, Pittsburgh, PA 15213
Dinner at Butterjoint
6:00-8:00

208 N Craig St, Pittsburgh, PA 15213

Travel Information

How to travel to and around Pittsburgh:

  • By plane via Pittsburgh International Airport. - Pittsburgh Regional Transit offers public transit service to and from Pittsburgh International Airport via the 28X Airport Flyer.  The 28X route serves Pittsburgh International Airport, Downtown Pittsburgh, and Oakland seven days a week.  Riders using cash to pay their transit fares must have exact change; credit cards are not accepted on vehicles.  Credit cards are accepted at the ticket vending machine in Baggage Claim inside Door #2. The ticket vending machine allows riders to buy daily, 7-day or 30-day tickets, or add stored value onto a ConnectCard or ConnecTix.
  • By train via Amtrak. - Amtrak's Union Station is located at 1100 Liberty Avenue, Pittsburgh, PA 15222.  Numerous Pittsburgh Regional Transit buses run from Downtown to CMU's campus in Oakland.
  • By long distance bus via Greyhound. - The Greyhound Bus Terminal is located five miles from campus in downtown Pittsburgh.  The station terminal is located at the intersection of 11th Street and Liberty Avenue
  • Local bus via Pittsburgh Regional Transport. - The PRT network offers bus, light rail, and incline services in Allegheny County.  Please see their website for schedules and rider information.
  • Visitor parking is available at the East Campus Garage, 5040 Forbes Ave, Pittsburgh, PA 15213.  For more information about visitor parking, including rates, please visit CMU's visitor information page.

The following hotels are located approximately 1 mile from CMU's campus.

  • Wyndham Pittsburgh University Center
    100 Lytton Ave, Pittsburgh, PA 15213
    +1 412-682-6200
    www.wyndhamhotels.com
  • The Oaklander Hotel, Autograph Collection
    5130 Bigelow Blvd, Pittsburgh, PA 15213
    +1 412-578-8500
    www.marriott.com
  • Hilton Garden Inn Pittsburgh University Place
    3454 Forbes Ave, Pittsburgh, PA 15213
    +1 412-683-2040
    www.hilton.com
  • Residence Inn by Marriott Pittsburgh Oakland/University Place
    3341 Forbes Ave, Pittsburgh, PA 15213
    +1 412-621-5600
    www.marriott.com
  • Hampton Inn Pittsburgh University/Medical Center
    3315 Hamlet St, Pittsburgh, PA 15213
    +1 412-681-1000
    www.hilton.com

Numerous cultural sites, entertainment options, and historical landmarks are located near Carnegie Mellon University.  We have marked several examples of each, as well as university locations and travel hubs, on the map below.