Envision Bootcamp
(Registration Closed):

Hands-on Introduction to Multimodal (Signal)
Analysis Techniques To gain Qualitative and Quantitative Understanding of Team Dynamics

8 – 10 December 2021 (Please note that the sessions run till 17:00* daily to allow for questions)

The Envision Dataset

Envision is a 4Tb corpus of video-taped design teams. The videos were recorded as part of a doctoral dissertation by Jonathan Edelman PhD at the Center for Design Research, Stanford. 42 participants, 26 of whom were male, and 16 of whom were female participated in the study. Their ages ranged from 19 to 77 years old.

Four streams of video: one for each of the three participants and one top-down camera over the table is used to capture how three individuals engage in redesigning a "Material Analyzer".


Envision also comprises transcripts and a close analysis of the behaviour of the teams in their interaction with different media. The central question was to explore how designers behave when they engage with different media. Envision captures interaction with different media; blueprints, rough and detailed prototypes, and design outcomes. The broader implication is how to explore design team behaviour to extract the microdynamics of design teams. Although the original dissertation leverages the dataset "qualitatively", we see immense value in taking a complementary quantitative approach to mapping and mining design behaviour. This multimodal approach will be explored in the Bootcamp using signal analysis techniques and will/can subsequently benefit from advanced computer vision, machine learning and deep learning techniques.


We invite you to explore how qualitative and quantitative multimodal analysis may be applied to the Envision Dataset to advance our understanding and facilitating of teams engaged in innovation and collaboration.


Provisional Agenda (12-4-2021)

Wednesday December 8th

  • 10:00 – 10:30 Introduction w/ Pouw, Trujillo, Owoyele, Edelman

  • 10:30 – 11:00 Overview team dynamics and Envision dataset
    w/ Edelman

  • 11:00 – 11:15 Coffee break

  • 11:15 – 11:30 Overview multimodal signal processing
    and applications w/ Pouw, Trujillo

  • 11:30 – 12:30 Introduction to video motion tracking
    w/ Pouw, Trujillo, Cwiek

  • 12:30 – 13:15 Lunch break

  • 13:15 – 14:15 Multimodal data analysis w/ Pouw, Trujillo

  • 14:15 – 14:30 Coffee break

  • 14:30 – 16:30 Deep Learning, AI, ML w/ De Melo

  • 16:30 – 17:00 Wrap-up, get-together, Q&A


Thursday December 9th

  • 10:00 – 10:15 Recap day 1 w/ Owoyele

  • 10:15 – 11:15 Multivariate Module w/ Pouw, Trujillo

  • 11:15 – 11:30 Coffee break

  • 11:30 – 12:00 Open Face w/ Trujillo

  • 12:00 – 12:30 Kinematic Features w/ Trujillo

  • 12:30 – 13:15 Lunch break

  • 13:15 – 14:15 Gesture network w/ Pouw

  • 14:15 – 14:45 Q&A + coffee break w/ Pouw, Trujillo

  • 14:45 – 16:45 Semantic network analyses w/ Fronzetti Colladon

  • 16:45 – 17:00 Wrap-up, get-together, Q&A


Friday December 10th

  • 10:00 – 10:15 Recap day 2 w/all

  • 10:15 – 11:15 Brainstorming on Envision data w/ Santuber

  • 11:15 – 11:20 Technical break

  • 11:20 – 12:20 Spacy for Envision w/ Manoj, De Melo

  • 12:20 – 13:00 Lunch break

  • 13:00 – 14:30 Data-driven vs. theory-driven research w/ Maass

  • 14:30 – 14:45 Coffe Break

  • 14:45 – 16:15 MultisSyncPY Python 4 Envision
    (+ technical break in-between) w/ Davis

  • 16:15 – 16:45 Research paper ideas w/ all

  • 16:45 – 17:00 Reflections, Q&A

Picture5 Result.png
DeepLab Cut.png
logo_horizontal_color media pipe.png

Envision Resources

Also, please follow this link to start to explore some of the modules in the Envision Toolbox. We advise everyone to download/clone the GitHub repository next week and update it on the final day so that you can follow along. We are still updating and adding modules this week (and maybe small changes next week). 

Due to Covid-19 regulations, most of you will be joining online. In order to fully benefit from the modules and presentations live during the boot camp, please prepare the following before the workshop:


  • Running Python with Jupyter Notebook (we use Anaconda install)

  • R with RStudio (so you can run R Markdown)

There will be no troubleshooting during the boot camp, unfortunately. However, all modules that we will be presenting will be available online after the event. So, no worries if you cannot follow along. We even advise you just to watch the tutorials and start tinkering with the scripts yourself later. Then you can troubleshoot, of course, by contacting the authors of the script.

Main pages and resources: 

Website - https://www.centerforadvanceddesignstudies.org/envision

GitHub repository - https://github.com/WimPouw/EnvisionBootcamp2021

Modules’ overview - https://wimpouw.github.io/EnvisionBootcamp2021/


Bootcamp Hosts

Photo WIM.png
download copy.jpg
  • Dr Wim Pouw 

  • Adjunct Professor Dr Jonathan Edelman

  • Dr James Trujillo 

  • Aleksandra Cwiek

  • Joaquin Santuber

  • Babajide Owoyele

  • Professor Dr Gerard De Melo

Photo James_edited.jpg
Photo Aleksandra Cwiek.jfif
Photo Gerard.jpg


Sorry, Registration is Closed!


Thank you again for registering your interest in the Envision boot camp at the Hasso Plattner Institute in Potsdam on December 8-10. We have received more than 60 registrations and look forward to a rich exchange on multimodal analysis from your diverse perspectives.


Some preliminary information about the hygiene concept for on-site participants:

Due to the current regulations of the Berlin Senate, we can only receive participants who have been vaccinated or have recovered in addition to onsite testing (2G+). A daily negative corona test is no longer sufficient. As in the earlier time, we will have to keep a minimum distance. It is compulsory to wear a mask up to your seat and while in motion. We will provide you with a complete hygiene concept when the boot camp is approaching.


You can view an updated program on the event page or by clicking on the link: https://www.centerforadvanceddesignstudies.org/envision


If, for any reason, you cannot join us anymore, please also let us know by sending an email to thisiscfads@gmail.com.


Best regards on behalf of the Envision Boot Camp team.




Campus 1

Griebnitzsee, Potsdam

S-Bahn Griebnitzsee