Björn Hartmann

Photo by Alex Greenspan

News

June 2023: Jacobs Institute

After 7 years, I am concluding my term as faculy director of the Jacobs Institute on June 30, 2023. Eric Paulos will be the next director.

Contact info

Office: 417 Sutardja Dai Hall
Berkeley, CA 94720-1760

Office Hours: Sign up

bjoern@eecs.berkeley.edu
t: @bjo3rn
RSO: Amy Frithsen, frithsen@berkeley.edu

Materials

Curriculum Vitae, Recent Talk Info
Archived Faculty Application Materials, Advice for Current and Prospective Students

I am an Associate Professor of Electrical Engineering and Computer Science at the University of California, Berkeley. I am broadly interested in tools to support human ingenuity, across a number of domains including design, programming and engineering. I am also interested in embodied cognition, especially in AR/VR. Methodologically, my group predominantly focuses on systems research: we contribute complex, working interactive systems that embody our research ideas and enable us to test specific hypotheses. However, I also appreciate (and we conduct) careful, controlled experiments. I hold the Paul and Judy Gray Alumni Presidential Chair in Engineering Excellence, was previously a Qualcomm Faculty Fellow and have received an NSF CAREER award, Sloan fellowship, and Okawa research award. My group predominantly publishes at the top HCI conferences UIST, CHI and CSCW. We also publish in more topic-specific venues like DIS, ICSE, VL/HCC, and Learning@Scale. Our work has received multiple best paper prizes at these conferences.

I am affiliated faculty in the Berkeley Institute of Design. Previously, from 2016-2023, I was the Faculty Director of the Jacobs Institute for Design Innovation. Prior to leading the Jacobs Institute, I co-founded the CITRIS Invention Lab, a lab equipped with many digital fabrication and rapid prototyping tools. The lab served as inspiration and testbed for many our research projects. I was also involved in the Swarm Lab. I spend time with great colleagues at the Berkeley Center for New Media, and the Visual Computing Lab. I received my PhD from the Stanford Computer Science department in 2009 where I worked with Scott Klemmer (dissertation). I received an MSE in Computer and Information Science as well as Undergraduate Degrees in Digital Media Design and Communication from the University of Pennsylvania in 2002.

Thinking about applying for a PhD/Masters/Internship/PostDoc in HCI at Berkeley?
Do not email me directly about your application or request - I cannot respond to every message. Read this advice instead.

Undergraduate Cal Student interested in (Interface) Design?
Take a look at the Berkeley Certificate in Design Innovation which has many relevant courses across the university. The Jacobs Institute's courses page is a another helpful resource. In Computer Science, you should take CS160. If you did well and want to deepen your understanding of HCI research and practice, sign up for CS260B or CS294-84 (Interactive Device Design). If you have completed either of these courses with outstanding results, come to my office hours to talk about undergraduate research opportunities.

Preprints, Posters, Works in Progress

Visual Prompting with Iterative Refinement for Design Critique Generation
Peitong Duan, Chin-Yi Chen, Bjoern Hartmann, Yang Li arXiv - Preprint December 2024

A Knowledge-Component-Based Methodology for Evaluating AI Assistants
Laryn Qi, J.D. Zamfirescu-Pereira, Taehan Kim, Björn Hartmann, John DeNero, Narges Norouzi arXiv - Preprint June 2024

Dreamcrafter: Immersive Editing of 3D Radiance Fields Through Flexible, Generative Inputs and Outputs
Cyrus Vachha, Yixiao Kang, Zach Dive, Ashwat Chidambaram, Anik Gupta, Eunice Jun, Björn Hartmann UIST 2024 - Poster

Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences
Shreya Shankar, J. D. Zamfirescu-Pereira, Björn Hartmann, Aditya G. Parameswaran, Ian Arawjo arXiv - Preprint April 2024

Papers

For a full list, see my profiles on: Google Scholar, or ACM DL.

2025

	Beyond Code Generation: LLM-supported Exploration of the Program Design Space J.D. Zamfirescu-Pereira, Eunice Jun, Michael Terry, Qian Yang, Björn Hartmann CHI 2025 We explore explicit Large Language Model (LLM)-powered support for the iterative design of computer programs. We contribute an IDE that supports program design through generating and showing new ways to frame problems alongside alternative solutions, tracking design decisions, and identifying implicit decisions made by either the programmer or the LLM. full paper Honorable Mention Award local pdf
	Dreamcrafter: Immersive Editing of 3D Radiance Fields Through Flexible, Generative Inputs and Outputs Cyrus Vachha, Yixiao Kang, Zach Dive, Ashwat Chidambaram, Anik Gupta, Eunice Jun, Björn Hartmann CHI 2025 We introduce Dreamcrafter, a VR-based 3D scene editing system that: (1) provides a modular architecture to integrate generative AI algorithms; (2) combines different levels of control for creating objects, including natural language and direct manipulation; and (3) introduces proxy representations that support interaction during high-latency operations. full paper local pdf
	Creativity Supportive Ecosystems: A Framework for Understanding Function and Disruption in Online Art Worlds Shm Garanganao Almeda, Joy S Kim, Björn Hartmann CHI 2025 We develop the creativity supportive ecosystem framework through interviews with 20 online artists, and 8 data stewards with experience reusing creative data for training GenAI. We use the CSE to describe how creative communities perceive and respond to disruption, identifying opportunities to empower artists in their collective negotiations with disruptive technologies like GenAI. full paper Honorable Mention Award local pdf
	Reimagining Misuse as Creative Practice: Impressions and Implications of Usage Norms on Digital Artists Isabel Li, Ace S. Chen, Eric Rawn, Shm Garanganao Almeda, Björn Hartmann, Jingyi Li CHI 2025 Digital artists use creativity support tools guided by their ideas of intended use and therefore misuse—but what does misuse mean in creative practice? We interviewed 20 expert creative practitioners across 8 visual art disciplines. We identify five sources of normativity which form conventions of misuse. full paper local pdf
	61A Bot Report: AI Assistants in CS1 Save Students Homework Time and Reduce Demands on Staff. (Now What?) J.D. Zamfirescu-Pereira, Laryn Qi, Bjoern Hartmann, John DeNero, Narges Norouzi SIGCSE TS 2025 Digital artists use creativity support tools guided by their ideas of intended use and therefore misuse—but what does misuse mean in creative practice? We interviewed 20 expert creative practitioners across 8 visual art disciplines. We identify five sources of normativity which form conventions of misuse. full paper local pdf, bibtex, doi

2024

	What's the Game, then? Opportunities and Challenges for Runtime Behavior Generation Nicholas Jennings, Han Wang, Isabel Li, James Smith, Björn Hartmann UIST 2024 Recent advances in large language models (LLMs) enable the generation of game behaviors based on player input at runtime. Such code generation brings with it the possibility of entirely new gameplay interactions that may be difficult to integrate with typical game development workflows. We explore these implications through GROMIT, a novel LLM-based runtime behavior generation system for Unity. full paper Best Paper Award local pdf, bibtex, doi
	UICrit: Enhancing Automated Design Evaluation with a UI Critique Dataset Peitong Duan, Chin-Yi Cheng, Gang Li, Björn Hartmann and Yang Li UIST 2024 We present a targeted dataset of 3,059 design critiques and quality ratings for 983 mobile UIs, collected from seven designers, each with at least a year of professional design experience. We carried out an in-depth analysis to characterize the dataset's features. We then applied this dataset to achieve a 55% performance gain in LLM-generated UI feedback via various few-shot and visual prompting techniques full paper local pdf, bibtex, doi
	Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences Shreya Shankar, J.D. Zamfirescu-Pereira, Björn Hartmann, Aditya Parameswaran and Ian Arawjo UIST 2024 Large Language Models (LLMs) are increasingly being used to assist humans in evaluating LLM outputs. Yet LLM-generated evaluators simply inherit all the problems of the LLMs they evaluate, requiring further human validation. We present a mixed-initiative approach to “validate the validators”— aligning LLM-generated evaluation functions (be it prompts or code) with human requirements. full paper local pdf, bibtex, doi
	Design Space Exploration for Board-level Circuits: Exploring Alternatives in Component-based Design Richard Lin, Rohit Ramesh, Parth Nitin Pandhare, Kai Jun Tay, Prabal Dutta, Bjoern Hartmann, and Ankur Mehta CHI 2024 In this work, we examine user-guided design space exploration as a middle ground between intuitive-but-ambiguous high-level representation of a circuit and a fully-specified, fabrication-ready circuit. full paper local pdf, doi
	Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation Susan Lin, Jeremy Warner, J.D. Zamfirescu-Pereira, Matthew G Lee, Sauhard Jain, Shanqing Cai, Piyawat Lertvittayakumjorn, Michael Xuelin Huang, Shumin Zhai, Bjoern Hartmann, Can Liu CHI 2024 This paper presents Rambler, an LLM-powered graphical user interface that supports gist-level manipulation of dictated text with gist extraction and macro revision. full paper local pdf, doi, show video
	Prompting for Discovery: Flexible Sense-Making for AI Art-Making with Dreamsheets Shm Garanganao Almeda, J.D. Zamfirescu-Pereira, Kyu Won Kim, Pradeep Mani Rathnam, Bjoern Hartmann CHI 2024 How can interfaces support end-users in reliably steering prompt-space explorations to- wards interesting results? Our design probe, DreamSheets, supports user-composed exploration strategies with LLM-assisted prompt construction and large-scale simultaneous display of generated re- sults, hosted in a spreadsheet interface. full paper local pdf, doi
	Generating Automatic Feedback on UI Mockups with Large Language Models Peitong Duan, Jeremy Warrner, Yang Li, Bjoern Hartmann CHI 2024 We explore the potential of using large language models for automatic feedback. Specifically, we focus on applying GPT-4 to automate heuristic evaluation, which currently entails a human expert assessing a UI’s compliance with a set of design guidelines. full paper local pdf, doi, show video

2023

	Interactive Flexible Style Transfer for Vector Graphics Jeremy Warner, Kyu Won Kim, Björn Hartmann UIST 2023 We present VST, Vector Style Transfer, a novel design tool for flexibly transferring visual styles between vector graphics. full paper local pdf, bibtex, doi, project page, show video
	Dual Body Bimanual Coordination in Immersive Environments James Smith, Xinyun Cao, Adolfo G. Ramirez-Aristizabal, Björn Hartmann DIS 2023 We investigate peoples abilities to perform coordinated bimanual selection and handoff tasks between a first-person and third-person body in VR through a user study with 19 participants. full paper local pdf, bibtex, doi, show video
	NFT Art World: The Influence of Decentralized Systems on the Development of Novel Online Creative Communities and Cooperative Practices Shm Garanganao Almeda, Björn Hartmann DIS 2023 Interviews with 16 creatives utilizing NFTs reveal unique artistic subcultures, philosophies, and interactions. We observe unique qualities of decentralized distribution platforms and identify patterns of activity comparable to those of traditional art worlds. We identify how aspects of these systems might subvert, or replicate, existing systems of power, value, and access. full paper local pdf, bibtex, doi
	Herding AI Cats: Lessons from Designing a Chatbot by Prompting GPT-3 JD Zamfirescu-Pereira, Heather Wei, Amy Xiao, Kitty Gu, Grance Jung, Matthew G Lee, Bjoern Hartmann, Qian Yang DIS 2023 This paper describes a case study of an attempt to design a robust chatbot by prompting GPT-3. It unpacks prompting’s fickleness and its impact on UX design processes, and discusses implications for LLM-based design methods and tools. full paper local pdf, bibtex, doi
	VR or Not? Investigating Interface Type and User Strategies for Interactive Design Space Exploration Ananya Nandy, James Smith, Nicholas Jennings, Michael Kuniavsky, Björn Hartmann, and Kosa Goucher-Lambert ICED 2023 We investigate strategies that emerge when people explore a large design space within either a non-immersive (2D) or immersive (VR) interface. Results from a 28 participant user study show that the interfaces differ in perceptions of enabling breadth or depth of exploration holistically, with preference towards 2D interfaces to compare options, and VR to understand single designs. full paper local pdf, bibtex, doi
	Why Johnny can’t prompt: how non-AI experts try (and fail) to design LLM prompts JD Zamfirescu-Pereira, Richmond Y Wong, Björn Hartmann, and Qian Yang CHI 2023 We explore whether non-AI-experts can successfully engage in end-user prompt engineering using a design probe - a prototype LLM-based chatbot design tool supporting development and systematic evaluation of prompting strategies. Our probe participants explored prompt designs opportunistically, not systematically, and struggled in ways echoing end-user programming systems and interactive machine learning systems. full paper local pdf, bibtex, doi
	SlideSpecs: Automatic and Interactive Presentation Feedback Collation Jeremy Warner, Amy Pavel, Tonya Nguyen, Maneesh Agrawala, Björn Hartmann IUI 2023 We present a tool to collate and contextualize both text and verbal feedback on slide presentations. full paper local pdf, bibtex, doi

2022

	Computational Support for Multiplicity in Hierarchical Electronics Design Richard Lin, Rohit Ramesh, Prabal Dutta, Bjoern Hartmann, Ankur Mehta SCF 2022 In this work, we explore two extensions of a hierarchical design model for electronics to support two types of multiplicity: scalable blocks and cross-hierarchy packing. full paper local pdf, bibtex, doi
	Concept-Annotated Examples for Library Comparison Litao Yan, Miryung Kim, Bjoern Hartmann, Tianyi Zhang, Elena Glassman UIST 2022 We designed a novel interactive interface, ParaLib, and used it as a technical probe to explore to what extent many side-by-side concepted-annotated examples can facilitate the library comparison and selection process. full paper local pdf, bibtex, doi
	Modeling and Influencing Human Attentiveness in Autonomy-to-Human Perception Hand-offs Yash Vardhan Pant, Balasaravanan Thoravi Kumaravel, Ameesh Shah, Erin Kraemer, Marcell Vazquez-Chanlatte, Kshitij Kulkarni, Bjoern Hartmann, Sanjit A Seshia IEEE ITSC 2022 In this paper, we consider the perception hand-off problem, which brings the driver into the loop when the perception module of an Autonomous Vehicle (AV) is uncertain about the environment. full paper local pdf, bibtex, doi
	Predicting and Explaining Mobile UI Tappability with Vision Modeling and Saliency Analysis Eldon Schoop, Xin Zhou, Gang Li, Zhourong Chen, Bjoern Hartmann, Yang Li CHI 2022 We contribute a novel system that models the perceived tappability of mobile UI elements with a vision-based deep neural network and helps provide design insights with dataset-level and instance-level explanations of model predictions. full paper local pdf, bibtex, doi, project page
	Interactive Mixed-Dimensional Media for Cross-Dimensional Collaboration in Mixed Reality Environments Balasaravanan Thoravi Kumaravel and Björn Hartmann Frontiers in Virtual Reality 2022 To address asymmetries in Mixed Reality environments, we introduce Interactive Mixed-Dimensional Media. In these media, the visual representation of information streams can be changed between 2D and 3D. Different representations can be chosen automatically, based on context, or through associated interaction techniques that give users control over exploring spatial, temporal, and dimensional levels of detail. journal paper local pdf, bibtex, doi

2021

Weaving Schematics and Code: Interactive Visual Editing for Hardware Description Languages
Richard Lin, Rohit Ramesh, Nikhil Jain, Josephine Koe, Ryan Nuqui, Prabal Dutta, Bjoern Hartmann
UIST 2021
In many engineering disciplines such as circuit board, chip, and mechanical design, a hardware description language (HDL) approach provides important benefits over direct manipulation interfaces by supporting concepts like abstraction and generator meta-programming. In this work, we investigate an IDE approach to provide a graphical editor for a board-level circuit design HDL.
full paper local pdf, bibtex, doi, project page

UMLAUT: Debugging Deep Learning Programs using Program Structure and Model Behavior
Eldon Schoop, Forrest Huang, Bjoern Hartmann
CHI 2021
In this work, we identify Deep Learning debugging heuristics and strategies used by experts, and we categorize the types of errors novices run into when writing ML code. We then describe opportunities where tools could help novices. Umlaut checks DL program structure and model behavior against these heuristics; provides human-readable error messages to users; and annotates erroneous model output to facilitate error correction.
full paper local pdf, bibtex, doi, project page, show video

Multi-level Correspondence via Graph Kernels for Editing Vector Graphics Designs
Hijung V. Shin, Jeremy Warner, Bjoern Hartmann, Celso Gomes, Holger Winnemoeller, and Wilmot Li
GI 2021
Graphic designs often contain repeating sets of elements with a similar structure. We introduce an algorithm that automatically computes this shared structure which enables graphical edits to be transferred from a set of source elements to multiple targets. For example, designers may want to propagate isolated edits to element attributes, apply nested layout adjustments, or transfer edits across different designs.
full paper local pdf, show video

2020

	Polymorphic Blocks: unifying high-level specification and low-level control for circuit board design Richard Lin, Rohit Ramesh, Connie Chi, Nikhil Jain, Ryan Nuqui, Prabal Dutta, Bjoern Hartmann UIST 2020 We propose a hardware description language (HDL) approach that supports users at multiple levels of abstraction from broad system architecture to subcircuits and component selection. We extend the familiar hierarchical block diagram with polymorphism to include abstract-typed blocks (e.g., generic resistor supertype) and electronics modeling (i.e., currents and voltages). Such an approach brings the advantages of reusability and encapsulation from object-oriented programming, while addressing the unique needs of electronics designers such as physical correctness verification. full paper local pdf, bibtex, doi, project page
	TransceiVR: Bridging Asymmetrical Communication Between External and VR Users Balasaravanan Thoravi Kumaravel, Cuong Nguyen, Stephen DiVerdi, Bjoern Hartmann UIST 2020 We present TransceiVR, a system that utilizes VR platform APIs to enable asymmetric communication interfaces for third-party applications without requiring source code access. TransceiVR allows external users to explore the VR scene spatially or temporally, to annotate elements in the VR scene at correct depths, and to discuss via a shared static virtual display. full paper local pdf, bibtex, doi, show video
	Composing Flexibly-Organized Step-by-Step Tutorials from Linked Source Code, Snippets, and Outputs Andrew Head, Jason Jiang, James Smith, Marti A. Hearst, and Björn Hartmann CHI 2020 Presents Torii, a new kind of computational notebook for authoring programming tutorials. The design is grounded in interviews with authors and a content analysis of 200 tutorials. In a lab study, 12 tutorial authors created flexibly-organized tutorials with the tool. full paper Honorable Mention local pdf, bibtex, doi, show video
	Enabling Data-Driven API Design with Community Usage Data: A Need-Finding Study Tianyi Zhang, Björn Hartmann, Miryung Kim, Elena L. Glassman CHI 2020 We interviewed 23 API designers from 6 companies and 11 open-source projects to understand their practices and needs. We highlight several opportunities to address those unmet needs, including developing new mechanisms that systematically elicit users' mental models, building mining frameworks that identify recurring patterns beyond shallow statistics about API usage, and exploring alternative design choices made in similar libraries. full paper local pdf, bibtex, doi, show video

2019

	LabelAR: A Spatial Guidance Interface for Fast Computer Vision Image Collection Michael Laielli, James Smith, Giscard Biamby, Trevor Darrell, Bjoern Hartmann UIST 2019 We present a novel interface for rapid collection and labeling of training images to improve computer vision- based object detectors. LabelAR leverages the spatial tracking capabilities of an AR-enabled camera, allowing users to place persistent bounding volumes that stay centered on real-world objects. The interface then guides the user to move the camera to cover a wide variety of viewpoints. full paper local pdf, bibtex, doi, project page, show video
	Loki: Facilitating Remote Instruction of Physical Tasks Using Bi-Directional Mixed-Reality Telepresence Balasaravanan Thoravi Kumaravel, Fraser Anderson, George Fitzmaurice, Bjoern Hartmann, Tovi Grossman UIST 2019 We explore the design space of bi-directional mixed-reality telepresence systems for teaching physical tasks. Loki leverages video, audio and spatial capture along with mixed-reality presentation methods to allow users to explore and annotate the local and remote environments, and record and review their own performance as well as their peer’s. full paper , bibtex, doi, project page, show video
	See-Thru: Towards Minimally Obstructive Eye-Controlled Wheelchair Interfaces Corten Singer and Björn Hartmann ASSETS 2019 We develop and evaluate an eye-controlled wheelchair navigation interface that minimizes obstruction to the user’s field of view by removing the conventional use of a computer screen as a feedback mechanism. We present See-Thru, an eye-tracking interface that provides feedback to the user without a screen while simultaneously providing a clear view of the path ahead. full paper local pdf, bibtex, doi
	Heimdall: A Remotely Controlled Inspection Workbench For Debugging Microcontroller Projects Mitchell Karchemsky, J.D. Zamdfirescu-Pereira, Kuan-Ju Wu, Francois Guimbretiere, Björn Hartmann CHI 2019 We introduce Heimdall, a remote electronics workbench that allows experts to visually inspect a student's circuit; perform measurements; and to re-wire and inject test signals. These interactions are enabled by an actuated inspection camera; an augmented breadboard that enables flexible configuration of row connectivity and measurement/injection lines; and a web-based UI that teachers can use to perform measurements through interaction with the captured images. full paper Honorable Mention local pdf, bibtex, doi
	Beyond Schematic Capture: Meaningful Abstractions for Better Electronics Design Tools Richard Lin, Rohit Ramesh, Antonio Iannopollo, Alberto Sangiovanni Vincentelli, Prabal Dutta, Elad Alon, Björn Hartmann CHI 2019 Printed Circuit Board (PCB) design tools are critical in helping users build non-trivial electronics devices. We interview fifteen PCB designers of a variety of backgrounds. Our open-ended, semi-structured interviews examine both overarching design flows and details of individual steps. One major finding was that most creative engineering work happens during system architecture, yet current tools operate at lower abstraction levels and create significant tedious work for designers. full paper local pdf, bibtex, doi
	TutoriVR: A Video-Based Tutorial System for Design Applications in Virtual Reality Balasaravanan Thoravi Kumaravel, Cuong Nguyen, Stephen DiVerdi, Björn Hartmann CHI 2019 We conduct a formative study to identify challenges faced by users in learning to VR-paint using video-based tutorials. Informed by results of this study, we develop a VR-embedded tutorial system that supplements video tutorials with 3D and contextual aids directly in the user's VR environment. full paper local pdf, bibtex, doi, project page, show video

2018

	WiFröst: Bridging the Information Gap for Debugging of Networked Embedded Systems William McGrath, Jeremy Warner, Mitchell Karchemsky, Andrew Head, Daniel Drew, Björn Hartmann UIST 2018 This paper presents WiFröst, a new approach for debugging networked embedded systems using instrumentation that spans from the device itself, to its communication API, to the wireless router and back-end server. WiFröst automatically collects this data, displays it in a web-based visualization, and highlights likely issues with an extensible suite of checks based on analysis of recorded execution traces. full paper local pdf, bibtex, doi, show video
	Visualizing API Usage Examples at Scale Elena Glassman, Tianyi Zhang, Björn Hartmann, Miryung Kim CHI 2018 We introduce an interactive visualization for exploring a large collection of code examples mined from open-source repositories at scale. This visualization summarizes hundreds of code examples in one synthetic code skeleton with statistical distributions for canonicalized statements and structures enclosing an API call. full paper local pdf, bibtex, doi, project page, show video
	Interactive Extraction of Examples from Existing Code Andrew Head, Elena Glassman, Marti Hearst, Björn Hartmann CHI 2018 We designed a mixed-initiative tool, CodeScoop, to help programmers extract executable, simplified code from existing code. full paper Honorable Mention local pdf, bibtex, doi, project page, show video
	HindSight: Enhancing Spatial Awareness by SonifyingDetected Objects in Real-Time 360-Degree Video Eldon Schoop, James Smith, Björn Hartmann CHI 2018 We introduce HindSight, a wearable system that increases spatial awareness by detecting relevant objects in live 360-degree video and sonifying their position and class through bone conduction headphones. full paper local pdf, bibtex, doi

2017

	Bifröst : Visualizing and Checking Behavior of Embedded Systems across Hardware and Software Will McGrath, Daniel Drew, Jeremy Warner, Majeed Kazemitabaar, Mitchell Karchemsky, David Mellis, Björn Hartmann UIST 2017 This paper presents a new development environment designed to illuminate the boundary between embedded code and circuits. Bifröst automatically instruments and captures the progress of the user’s code, variable values, and the electrical and bus activity occurring at the interface between the processor and the circuit it operates in. This data is displayed in a linked visualization that allows navigation through time and program execution, enabling comparisons between variables in code and signals in circuits. full paper local pdf, bibtex, doi, show video
	Shot-Based Orientation Control for 360-Degree Video Amy Pavel, Björn Hartmann, Maneesh Agrawala UIST 2017 We present new interactive shot orientation techniques that are designed to help viewers see all of the important content in 360-degree video stories. short paper local pdf, bibtex, show video
	Debugging Unexpected CodeBehavior Using Synthesized Code Corrections Ryo Suzuki, Gustavo Soares, Andrew Head, Elena Glassman, Ruan Reis, Melina Mongiovi, Loris D’antoni and Björn Hartmann VLHCC 2017 Introduces a novel interface to help novice programmers debug incorrect assignments by visualizing where execution diverges from the closest correct program. full paper
	Turning coders into makers: the promise of embedded design generation Rohit Ramesh, Richard Lin, Antonio Iannopollo, Alberto Sangiovanni-Vincentelli, Björn Hartmann, Prabal Dutta SCF 2017 We present a novel methodology for embedded design generation that allows the generation of complete designs from high-level specifications. Starting from user-specified requirements and a library of available components, our tool encodes the design space as a system of constraints. Constraint solvers then reason over these constraints to create a block diagram with sufficient information to generate the device firmware and circuit netlist. full paper local pdf, bibtex, doi
	Machine Learning for Makers: Interactive Sensor Data Classification Based on Augmented Code Examples David Mellis, Ben Zhang, Audrey Leung, and Björn Hartmann DIS 2017 ESP (Example-based Sensor Prediction) leverages expert-authored machine learning pipelines to drive an auto-generated interface that allows machine-learning novices to modify and adapt the pipelines for use in their own projects. ESP allows novices to visualize pipeline performance; manage training data; and configure pipeline parameters. full paper Honorable Mention Award local pdf, bibtex, doi
	Writing Reusable Code Feedback at Scale with Mixed-Initiative Program Synthesis Andrew Head, Elena Glassman, Gustavo Soares, Ryo Suzuki, Lucas Figueredo, Loris D'Antoni, Björn Hartmann Learning@Scale 2017 In large classes, teacher feedback on individual student coding mistakes is not typically feasible. We contribute a new mixed-initiative approach which combines the teacher’s judgement and expertise with data-driven program synthesis techniques that cluster buggy student solutions and learn code transformations from examples full paper local pdf, bibtex, doi
	Learning Syntactic Program Transformations from Examples Reudismam Rolim, Gustavo Soares, Björn Hartmann, Loris D’Antoni, Oleksandr Polozov, Sumit Gulwani, Rohit Gheyi, Ryo Suzuki ICSE 2017 We present Refazer, a technique for automatically generating program transformations, building on the observation that code edits performed by developers can be used as input-output examples for learning program transformations. Our technique introduces a novel domain-specific language (DSL) for describing program transformations; domain-specific deductive algorithms for efficiently synthesizing transformations in the DSL; and functions for ranking the synthesized transformations. full paper local pdf, bibtex, doi

2016

	A Research Agenda for Academic Makerspaces Björn Hartmann ISAM 2016 This paper lays out a landscape of possible engagements between research and makerspaes in academia. position paper (4 pages) local pdf
	Authoring Illustrations of Human Movements by Iterative Physical Demonstration Pei-Yu (Peggy) Chi, Mira Dontcheva, Wilmot Li, Daniel Vogel, Björn Hartmann UIST 2016 We introduce a multimodal approach for people to generate illustrations of human movements by physically demonstrating the movements. full paper (10 pages) local pdf, bibtex, doi, show video
	The Toastboard: Ubiquitous Instrumentation and Automated Checking of Breadboarded Circuits Daniel Drew, Julie Newcomb, William McGrath, Filip Maksimovic, David Mellis, Björn Hartmann UIST 2016 This paper presents a novel debugging tool for electronic design projects, the Toastboard, that aims to reduce debugging time by improving upon the standard paradigm of point-wise circuit measurements. Ubiquitous instrumentation allows for immediate visualization of an entire breadboard's state. Critical information is displayed visually on the circuit itself and quantitative data is displayed on the accompanying web interface. Software-based testing functions further lower the expertise threshold for efficient debugging by diagnosing classes of circuit errors automatically. full paper (8 pages) local pdf, bibtex, doi, show video
	Video-based Asynchronous Video Review Amy Pavel, Dan Goldman, Björn Hartmann, Maneesh Agrawala UIST 2016 We introduce VidCrit, a system for providing asynchronous feedback on drafts of edited video that incorporates favorable qualities of an in-person review. full paper (10 pages) local pdf, bibtex, doi, show video
	Fiat Lux – Interactive Urban Lights for Combining Positive Emotion and Efficiency Pablo Paredes, Ryuka Ko, Eduaro Calle-Ortiz, Björn Hartmann, John Canny, Greg Niemeyer DIS 2016 Introduces a novel interactive urban light system focused on increasing positive affect for pedestrians. full paper local pdf, bibtex, doi
	Engaging Amateurs in the Design, Fabrication and Assembly of Electronic Products David Mellis, Leah Buechley, Mitchel Resnick, and Björn Hartmann DIS 2016 This paper explores personal fabrication as a means of engaging new audiences in the creation of electronic devices, which play an ever-increasing role in our lives but which most people have little involvement in creating. We describe a six-session workshop in which participants made wifi-connected devices through the design and fabrication of custom printed circuit boards. full paper local pdf, bibtex, doi, project page
	Enhancing Cross-Device Interaction Scripting with Interactive Illustrations Pei-yu (Peggy) Chi, Yang Li, and Björn Hartmann CHI 2016 To assist developers in programming cross-device interactions, we created DemoScript, a technique that automatically analyzes a cross-device interaction program and visually illustrates the step-by-step execution of a selected portion with a novel, automatically generated cross-device storyboard visualization full paper (12 pages) Best Paper Award local pdf, bibtex, doi, show video
	Drill Sergeant: Supporting Physical Construction Projects Through an Ecosystem of Augmented Tools Schoop, Eldon and Nguyen, Michelle and Lim, Daniel and Savage, Valkyrie and Follmer, Sean and Hartmann, Björn CHI 2016 Late-Breaking Work extended abstract Best Late Breaking Work Award local pdf, bibtex, doi
	Almost an Expert: The Effects of Rubrics and Expertise on Perceived Value of Crowdsourced Design Critiques Alvin Yuan, Kurt Luther, Markus Krause, Sophie Vennix, Steven P Dow, Björn Hartmann CSCW 2016: Computer-Supported Cooperative Work and Social Computing Expert feedback is valuable but hard to obtain for many designers. Online crowds can provide a source of fast and affordable feedback, but workers may lack relevant domain knowledge and experience. Can expert rubrics address this issue and help novices provide expert-level feedback? To evaluate this, we conducted an experiment with a 2x2 factorial design. full paper (12 pages) local pdf, bibtex, doi, project page
	Data-Driven Adaptive History List for Image Editing Hsiang-Ting Chen, Li-Yi Wei, Björn Hartmann, Maneesh Agrawala I3D 2016: ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games We introduce adaptive history, a UI mechanism that groups relevant operations together to reduce user workloads in image editing. full paper (9 pages) local pdf, bibtex, doi, project page, show video

2015

	SceneSkim: Searching and Browsing Movies Using Synchronized Captions, Scripts and Plot Summaries Amy Pavel, Dan Goldman, Björn Hartmann, and Maneesh Agrawala UIST 2015: ACM Symposium on User Interface Software and Technology We introduce SceneSkim, a tool for search- ing and browsing movies using synchronized captions, scripts and plot summaries. full paper (10 pages) local pdf, bibtex, doi, project page, show video
	Makers’ Marks: Physical Markup for Designing and Fabricating Functional Objects Valkyrie Savage, Sean Follmer, Jingyi Li, and Björn Hartmann UIST 2015: ACM Symposium on User Interface Software and Technology We aim to allow makers to design and 3D print functional mechanical and electronic assemblies. Makers’ Marks is a system based on physical authoring of assemblies using sculpting materials and annotation stickers. short paper (6 pages) local pdf, bibtex, doi, show video
	Tutorons: Generating Context-Relevant, On-Demand Explanations and Demonstrations of Online Code Andrew Head, Codanda Appachu, Marti A. Hearst, Björn Hartmann VL/HCC 2015: Visual Languages and Human-Centered Computing We propose language-specific routines called Tutorons that automatically generate on-demand, context-relevant micro-explanations of code. A Tutoron detects explainable code in webpages, parses it, and generates in-situ natural language explanations and demonstrations of code. full paper (9 pages) Honorary Mention local pdf, project page
	fabryq: Using Phones as Gateways to Prototype Internet of Things Applications using Web Scripting Will McGrath, Mozziyar Etemadi, Shuvo Roy and Björn Hartmann EICS 2015 We present fabryq, a platform that simplifies the prototyping and deployment of MGC applications (embedded-gateway-cloud). fabryq uses smartphones as bridges that connect devices using the short range wireless technology, Bluetooth Low Energy (BLE), to the Internet. full paper (10 pages) Best Paper Award local pdf, bibtex, doi
	Lamello: Passive Acoustic Sensing for Tangible Input Components Valkyrie Savage, Andrew Head, Björn Hartmann, Dan Goldman, Gautham Mysore and Wilmot Li CHI 2015 We describe Lamello, an approach for creating tangible input components that recognize user interaction via passive acoustic sensing. Lamello generates tine structures undeneath components and predicts the fundamental frequency of each fabricated tine based on its geometry: thus, recognition does not require training. note (4 pages) local pdf, bibtex, doi
	How Can Automatic Feedback Help Students Construct Automata? Loris D'Antoni, Dileep Kini, Rajeev Alur, Sumit Gulwani, Mahesh Viswanathan, Björn Hartmann TOCHI: ACM Transactions on Computer-Human Interaction We contribute a novel way to automatically compute conceptual hints for DFA constructions, and perform an evaluation of feedback types with 377 students. We find that providing either counterexamples or conceptual hints is judged as helpful, increases student perseverance, and can improve problem completion time. journal paper local pdf, bibtex, doi, project page
	Structuring Interactions for Large-Scale Synchronous Peer Learning Derrick Coetzee, Seongtaek Lim, Armando Fox, Björn Hartmann, Marti Hearst CSCW 2015: Computer-Supported Cooperative Work and Social Computing Investigates how to introduce synchronous interactive peer learning into online settings appropriate for crowdworkers and students in massive open online courses. full paper (14 pages) local pdf, bibtex, doi
	Structuring, Aggregating, and Evaluating Crowdsourced Design Critique Kurt Luther, Jari-lee Tolentino, Wei Wu, Amy Pavel, Maneesh Agrawala, Brian Bailey, Björn Hartmann, Steven Dow CSCW 2015: Computer-Supported Cooperative Work and Social Computing Presents CrowdCrit, a web-based system that allows designers to receive design critiques from non-expert crowd workers. full paper (13 pages) local pdf, bibtex, doi

2014

	HOBS: Head Orientation-Based Selection in Physical Spaces Ben Zhang, Yu-Hsiang Chen, Claire Tuna, Achal Dave, Yang Li, and Björn Hartmann SUI2014: ACM Symposium on Spatial User Interaction We present the iterative design and evaluation of a head orientation-based selection technique for interacting with smart devices at a distance. We augment a commercial wearable device, Google Glass, with an infrared (IR) emitter to select targets equipped with IR receivers. full paper (9 pages) local pdf, bibtex, doi, project page, show video
	Video Digests: A Browsable, Skimmable Format for Informational Lecture Videos Amy Pavel, Colorado Reed, Björn Hartmann, and Maneesh Agrawala UIST2014: ACM Symposium on User Interface Software and Technology We present a set of tools to construct video digests, a new format for informational videos that afford browsing and skimming by segmenting videos into a chapter/section structure and providing short text summaries and thumbnails for each section. full paper (10 pages) local pdf, bibtex, doi, project page
	A Series of Tubes: Adding Interactivity to 3D Prints Using Internal Pipes Valkyrie Savage, Ryan Schmidt, Tovi Grossman, George Fitzmaurice, and Björn Hartmann UIST2014: ACM Symposium on User Interface Software and Technology We introduce a general technique to support rapidly prototyping interactivity by removing interior material from 3D models to form internal pipes. full paper (10 pages) local pdf, bibtex, doi, project page, show video
	The Swarm at the Edge of the Cloud Edward A. Lee, Jan Rabaey, David Blaauw, Prabal Dutta, Kevin Fu, Carlos Guestrin, Bjoern Hartmann, Roozbeh Jafari, Douglas L. Jones, John D. Kubiatowicz, Vijay Kumar, Rahul Mangharam, Brian T. Murray, George Pappas, Kris Pister, Anthony Rowe, Alberto Sangiovanni-Vincentelli, Sanjit A. Seshia, Tajana Simunic Rosing, Ben Taskar, John Wawrzynek, David Wessel IEEE Design & Test magazine article local pdf, bibtex, doi
	CodeHint: Dynamic and Interactive Synthesis of Code Snippets Joel Galenson, Philip Reames, Rastislav Bodik, Björn Hartmann, Koushik Sen ICSE 2014 Presents a new technique for synthesizing code snippets by generating and evaluating code at runtime. Two user studies demonstrate impact on programmer productivity. full paper local pdf, bibtex, doi
	History Assisted View Authoring for 3D Models Hsiang-Ting Chen, Tovi Grossman, Li-Yi Wei, Ryan Schmidt, Björn Hartmann, George Fitzmaurice, Maneesh Agrawala CHI 2014 We present a view authoring assistance system that supports the creation of informative view points, paths, and surfaces for 3D models. By analyzing the model's workflow history, we infer important regions of the model and representative viewpoints of those areas. full paper (10 pages) local pdf, bibtex, doi, show video
	Chatrooms in MOOCs: All talk and no action? Derrick Coetzee, Armando Fox, Marti A. Hearst, Björn Hartmann LAS2014: ACM Conference on Learning at Scale We study effects of introducing a real-time chatroom into a massive open online course with several thousand students. Contrary to suggested benefits in prior work, we find no significant effect of chat use on objective or subjective dependent variables such as grades, retention, forum participation, or students’ sense of community. full paper (10 pages) local pdf, bibtex, doi
	Should Your MOOC Forum Use a Reputation System? Derrick Coetzee, Armando Fox, Marti A. Hearst, Björn Hartmann CSCW2014: ACM Conference on Computer-Supported Cooperative Work We investigate how forum design affects student activity and learning outcomes through a field experiment with 1101 participants on the edX platform. full paper (12 pages) local pdf, bibtex, doi

2013

	Browsing and Analyzing the Command-Level Structure of Large Collections of Image Manipulation Tutorials Amy Pavel, Floraine Berthouzoz, Björn Hartmann and Maneesh Agrawala Technical Report No. UCB/EECS-2013-167 Presents Sifter, an interface for browsing, comparing and analyzing large collections of image manipulation tutorials based on their command-level structure. tech report local pdf, bibtex, doi
	Identifying Redundancy and Exposing Provenance in Crowdsourced Data Analysis Wesley Willett, Shiry Ginosar, Avital Steinitz, Björn Hartmann, and Maneesh Agrawala IEEE Transactions on Visualization and Computer Graphics Presents a system that uses paid crowd workers to explore data sets and help analysts interactively generate explanations for trends and patterns. full paper local pdf, bibtex, project page
	Designing Bespoke Interactive Devices Björn Hartmann and Paul K. Wright IEEE Computer August 2013, Volume 46, Number 8, pp. 85-89 Describes teaching experiences with designing and building novel interactive devices in the CITRIS Invention Lab. magazine article local pdf, bibtex, doi, project page
	Sauron: Embedded Single-Camera Sensing of Printed Physical User Interfaces Valkyrie Savage, Colin Chang, and Björn Hartmann UIST2013: ACM Symposium on User Interface Software and Technology Sauron offers a machine vision-based approach for sensing human input on 3D-printed physical prototypes. Designers add a single camera to their prototype which tracks the motion and position of buttons, sliders, joysticks, and other input devices. full paper (10 pages) local pdf, bibtex, doi, show video
	DemoCut: Generating Concise Instructional Videos for Physical Demonstrations Pei-Yu Chi, Joyce Liu, Mira Dontcheva, Wilmot Li, and Björn Hartmann UIST2013: ACM Symposium on User Interface Software and Technology A semi-automatic video editing system that asks users to mark key moments in a recorded instructional demonstration. Uses audio and video analysis to automatically organize the video into meaningful segments and apply appropriate video editing effects. full paper (10 pages) local pdf, bibtex, doi, project page, show video
	Authoring Multi-Stage Code Examples with Editable Code Histories Shiry Ginosar, Björn Hartmann, Maneesh Agrawala UIST2013: ACM Symposium on User Interface Software and Technology An IDE extension that helps with the task of authoring multi-stage code examples by allowing the author to propagate changes (insertions, deletions and modifications) throughout multiple saved stages of their code. full paper (10 pages) local pdf, bibtex, doi, show video
	HydraScope: Creating Multi-Surface Meta-Applications Through View Synchronization and Input Multiplexing Björn Hartmann, Michel Beaudouin-Lafon and Wendy Mackay PerDis2013: ACM International Symposium on Pervasive Displays Introduces HydraScope, a framework for transforming existing web applications into meta-applications that execute and synchronize multiple copies of applications in parallel, with a multi-user input layer for interaction. paper local pdf, bibtex, doi, show video
	FAB at CHI: Digital Fabrication Tools, Design, and Community David Mellis, Sean Follmer, Björn Hartmann, Leah Buechley, and Mark D. Gross CHI 2013 Workshop local pdf, bibtex, doi

2012

	Midas: Fabricating Custom Capacitive Touch Sensors to Prototype Interactive Objects Valkyrie Savage, Xiaohan Zhang and Björn Hartmann UIST2012: ACM Symposium on User Interface Software and Technology Midas enables users to define discrete and continuous touch sensors with custom shapes and layout. The toolkit generates fabrication files and assembly instructions and enables designers to define interaction events. full paper (9 pages) local pdf, bibtex, doi, show video
	Proton++: A Customizable Declarative Multitouch Framework Kenrick Kin, Björn Hartmann, Tony DeRose, and Maneesh Agrawala UIST2012: ACM Symposium on User Interface Software and Technology Proton++ is a declarative multitouch framework that allows developers to describe multitouch gestures as regular expressions of touch event symbols. It allows developers to incorporate custom touch attributes directly into the gesture description. full paper (10 pages) local pdf, bibtex, doi, project page, show video
	MixT: Automatic Generation of Step-by-Step Mixed Media Tutorials Pei-Yu (Peggy) Chi, Sally Ahn, Amanda Ren, Mira Dontcheva, Wilmot Li, and Björn Hartmann UIST2012: ACM Symposium on User Interface Software and Technology Presents MixT, a system that automatically generates step-by-step mixed media tutorials from user demonstrations. MixT segments screencapture video into steps using a log of application events, applies video compositing techniques to focus on salient information, and highlights interactions through mouse trails. full paper (10 pages) local pdf, bibtex, doi, show video
	MobileWorks: Designing for Quality in a Managed Crowdsourcing Architecture Anand Kulkarni, Philipp Gutheim, Prayag Narula, David Rolnitzky, Tapan Parikh, Björn Hartmann IEEE Internet Computing, Sep/Oct 2012 We share experiences from building MobileWorks, a crowd platform focused on providing reliable, high-quality results. Four architectural contributions yield high quality: a standardized task-object-answer model; a peer review system; a dynamic work queue; and a set of social management techniques. magazine article local pdf, bibtex, doi
	Showing is Sharing: Building Shared Understanding in Human-Centered Design Teams with Dazzle Lora Oehlberg, Kyu Simm, Jasmine Jones, Alice Agogino and Björn Hartmann DIS2012: ACM Conference on Designing Interactive Systems Introduces Dazzle, a collaborative shared display system for co-located design team meetings, in which participants bring their own computing devices. Dazzle associates the action of showing information on the shared display with allowing the rest of the team access to that information: showing is sharing. full paper local pdf, bibtex, doi
	Communitysourcing: Engaging Local Crowds to Perform Expert Work Via Physical Kiosks Kurtis Heimerl, Brian Gawalt, Tapan Parikh, and Björn Hartmann CHI2012: ACM Conference on Human Factors in Computing Systems Introduces communitysourcing, the use of physical kiosks to elicit work from specific populations. Demonstrates the potential of communitysourcing by designing, implementing and evaluating Umati: the communitysourcing vending machine. full paper Best Paper Award local pdf, bibtex, doi, project page, show video
	Proton: Multitouch Gestures as Regular Expressions Kenrick Kin, Björn Hartmann, Tony DeRose and Maneesh Agrawala CHI2012: ACM Conference on Human Factors in Computing Systems Introduces Proton, a multi-touch input framework based on regular expressions. Contributes gesture tablature, a graphical notation for authoring expressions, and static analysis of gesture conflicts. full paper local pdf, bibtex, doi, project page, show video
	Delta: A Tool For Representing and Comparing Workflows Nicholas Kong, Tovi Grossman, Björn Hartmann, George Fitzmaurice and Maneesh Agrawala CHI2012: ACM Conference on Human Factors in Computing Systems Presents Delta, an interactive workflow visualization and comparison tool that helps users identify the tradeoffs between workflows. full paper local pdf, bibtex, doi, project page, show video
	Shepherding the Crowd Yields Better Work Steven Dow, Anand Kulkarni, Scott R. Klemmer, and Björn Hartmann CSCW2012: ACM Conference on Computer-Supported Cooperative Work Investigates the role of feedback in crowdsourced work. A field experiment with the Shepherd system shows that self-assessment and external feedback help workers learn task criteria and produce better work. full paper local pdf, bibtex, doi
	Collaboratively Crowdsourcing Workflows with Turkomatic Anand Kulkarni, Matthew Can, and Björn Hartmann CSCW2012: ACM Conference on Computer-Supported Cooperative Work Presents Turkomatic, a tool that recruits crowd workers to aid requesters in planning and solving complex tasks. full paper local pdf, bibtex, doi, project page
	Teaching Human-Centered Design Innovation Across Engineering, Humanities and Social Sciences Lora Oehlberg, Ian Leighton, Alice Agogino, and Björn Hartmann International Journal of Engineering Education Describes two educational programs at the University of California, Berkeley, which engage undergraduates from multiple disciplines in design education. journal paper local pdf

2011

	Stacksplorer: Call Graph Navigation Helps Increasing Code Maintenance Efficiency Thorsten Karrer, Jan-Peter Krämer, Jonathan Diehl, Björn Hartmann and Jan Borchers UIST2011: ACM Symposium on User Interface Software and Technology Stacksplorer provides a novel way to visualize potential call stacks within a traditional IDE and supports navigating along these call stacks. full paper (8 pages) local pdf, bibtex, doi, project page
	ShowMeHow: Translating User Interface Instructions Between Similar Applications Vidya Ramesh, Charlie Hsu, Maneesh Agrawala, and Björn Hartmann UIST2011: ACM Symposium on User Interface Software and Technology Introduces UI translation interfaces which enable users to locate commands in one application using the interface language of another application. full paper (8 pages) local pdf, bibtex, doi, show video
	Two-Handed Marking Menus for Multitouch Devices Kenrick Kin, Björn Hartmann, and Maneesh Agrawala ACM TOCHI 18,3, Article 16 (July 2011) Investigates multi-stroke marking menus for multitouch devices and shows that using two hands can improve performance. journal paper local pdf, bibtex, doi, show video
	What’s the Right Price? Pricing Tasks for Finishing on Time Siamak Faridani, Björn Hartmann, and Panos G. Ipeirotis AAAI Workshop on Human Computation 2011 Devises a job pricing algorithm for online labor markets using survival analysis. Shows that worker arrivals can be modeled as a non-homogeneous Poisson Process (NHPP). Presents an model that captures the dynamics of the market when full market information is presented. workshop paper local pdf
	Design Lessons from the Fastest Q&A Site in the West Lena Mamykina, Bella Manoim, Manas Mittal, George Hripcsak, and Björn Hartmann CHI2011: ACM Conference on Human Factors in Computing Systems Analyzes a Question & Answer site for programmers, Stack Overflow, that dramatically improves on the utility and performance of Q&A systems for technical domains. full paper honorable mention award local pdf, bibtex, doi, project page
	HyperSource - Bridging the Gap Between Source and Code-Related Web Sites Björn Hartmann, Mark Dhillon, and Matthew Chan CHI2011: ACM Conference on Human Factors in Computing Systems Introduces HyperSource, an IDE augmentation that associates browsing histories with source code edits. tech note local pdf, bibtex, doi, project page, show video
	Designing a Professional Multitouch Tool for Constructing Virtual Organic Environments Kenrick Kin,Tom Miller,Björn Bollensdorff,Tony DeRose,Björn Hartmann,Maneesh Agrawala CHI2011: ACM Conference on Human Factors in Computing Systems Introduces Eden, a fully functional multitouch application for professional set construction in computer-animated film. Discusses design lessosn for multitouch applications for professionals. full paper honorable mention award local pdf, bibtex, doi, project page, show video

2010

	Soylent: A Word Processor With a Crowd Inside Bernstein, M. S., Little, G., Miller, R.C., Hartmann, B., Ackerman, M., Karger, D., Crowell, D., Panovich, K. UIST2010: ACM Symposium on User Interface Software and Technology Introduces Soylent, a crowd-powered word processor plug-in. full paper best student paper award local pdf, bibtex, doi, show video
	What Would Other Programmers Do? Suggesting Solutions to Error Messages. Hartmann, Björn, MacDougall, D., Brandt, J., and Klemmer, S.R. CHI 2010: ACM Conference on Human Factors in Computing Systems. Introduces HelpMeOut, a social recommender system that aids the debugging of error messages during programming by suggesting solutions that peers have applied in the past. full paper honorable mention award local pdf, bibtex, doi, show video
	d.note: revising user interfaces through change tracking, annotations, and alternatives. Hartmann, Björn and Follmer, Sean and Ricciardi, Antonio and Cardenas, Timothy and Klemmer, Scott R. CHI 2010: ACM Conference on Human Factors in Computing Systems. Introduces d.note, a revision tool for user interface prototypes. Reports two studies that compare production and interpretation of revisions in d.note to sketching on static images. full paper local pdf, bibtex, doi
	Programming by a sample: Leveraging Web sites to program their underlying services. Björn Hartmann, Leslie Wu, Kevin Collins, and Scott R. Klemmer. In A. Cypher, M. Dontcheva, T. Lau, J. Nichols (eds). No Code Required: Giving Users Tools to Transform the Web. Burlington: Morgan Kaufmann book chapter
	Pictionaire: Supporting Collaborative Design Work by Integrating Physical and Digital Artifacts. Hartmann, Björn, Morris, M.R., Benko, H., and Wilson, A. CSCW 2010: ACM Conference on Computer Supported Cooperative Work. note local pdf, bibtex, doi, show video

2009

Augmenting Interactive Tables with Mice & Keyboards.
Hartmann, Björn, Morris, M.R., Benko, H., and Wilson, A.
UIST 2009: ACM Symposium on User Interface Software and Technology.
Describes interaction techniques for using traditional input devices on large interactive horizontal displays.
tech note local pdf, bibtex, doi, show video

Gaining Design Insight Through Interaction Prototyping Tools
Björn Hartmann
Stanford University Computer Science Department
Dissertation local pdf, bibtex

Teaching

Spring 2025

CS160 / CS260A User Interface Design and Development
TTh 2-3:30pm; 310 Jacobs Hall; 4 units.
GSIs: Tim Aveni, James Smith

Students & Collaborators

Advisees

PostDocs: Eddie Kim (co-advised with Sanjit Seshia)
PhD: Timothy Aveni (co-advised with Armando Fox), Peitong Duan, Shm Garanganao Almeda, James Smith, J.D. Zamfirescu-Pereira
Masters:

Alumni

PostDoc: Elena Glassman (@Harvard) Gustavo Soares'17 (@Microsoft), David Mellis'16 (@Autodesk), John MacCallum'16 (@INRIA), Mozziyar Etemadi'14 (w/ Shuvo Roy, MD PhD, @Northwestern)

PhD: Jeremy Warner'23 (Dissertation, Research Scientist at Apple), Eldon Schoop'22 (Dissertation, Research Scientist at Apple), Bala Kumaravel'22 (Dissertation, Senior Research Scientist at Microsoft), Richard Lin'21 (w/ Elad Alon, Dissertation, Postdoc, UCLA), Andrew Head'20 (w/ M. Hearst, Dissertation, Faculty, UPenn), Amy Pavel'19 (w/ M. Agrawala, Dissertation, Faculty UT Austin), Will McGrath'19 (w/ P. Levis, Dissertation, Google), Valkyrie Savage'16 (Dissertation, Faculty, U Copenhagen), Peggy Chi'16 (Dissertation, Research Scientist at Google), Lora Oehlberg '12 (ME, w/ A. Agogino, Faculty, U Calgary), Kenrick Kin'12 (EECS, w/ M. Agrawala, @Oculus)

Master's: Nicholas Jennings'23, Cyrus Vachha'23 (@Princeton PhD), Kyu Won Kim'22 (MS Report, @Aurora Solar), Nidhi Kakulawaram'21 (MS Report), Stephanie Daffara'20 (MS Report, @Pixar), Kunal Chaudhary'19 (MS Report), James Smith'19 (MS Report, @Berkeley PhD), Corten Singer'18 (MS Report), Michelle Nguyen'16 (MS Report, @Trifacta), Alvin Yuan'15 (MS Report, @Shopkick), Manas Mittal'14 (@Google), Wei Wu'13 (@Yelp), Philipp Gutheim'12 (@MobileWorks,Google), Drew Fisher'12 (w/ D. Wagner, @AeroFS)

Secondary co-advising: Julie Newcomb (UW, primary: R. Bodik), Ben Zhang (EECS, primary: E. Lee), D Coetzee'15 (EECS, primary: A. Fox), Kurtis Heimerl (EECS, primary: E. Brewer), Shiry Ginosar (now PhD w/ A. Efros), Anand Kulkarni (IEOR, primary: J. Shewchuck, CEO @MobileWorks)

Undergraduates: Woojin Ko'21 (@Cornell PhD), Tomas Vega'17, Michelle Chang, Mitchell Karchemsky'18, Jingyi Li'16, Eldon Schoop'16, Claire Tuna, Mark Dhillon (@Madison MS), Matthew Chan (@Irvine PhD), Matthew Can (@Stanford PhD), Vidya Ramesh (@Stanford MS), Brandon Liu (@Square), Charlie Hsu (@Twilio), Kyu Simm (@LifeCheck)

External: Manuel Kallenbach'11 (RWTH Aachen, MS, w/ Jan Borchers), Denis Bouchinet'12 (Paris Sud, w/ Michel Beaudouin-Lafon)

Summer interns: Mary Beth Kery'13 (SUPERB, Wellesley, now @CMU PhD), Christie Dierk'13 (SUPERB, Elon, now @Berkeley PhD), Jasmine Jones'11 (SUPERB, UMBC, now @Michigan PhD), Kehontas Rowe'11 (SUPERB, Mills College), Bella Manoim'10 (SUPERB, Bard College)

In Memoriam

Tim Campbell, Floraine Berthouzoz, David Dornfeld, David Wessel.

Recent Collaborators

Maneesh Agrawala (Stanford), Paul Wright (Berkeley), Tapan Parikh (Berkeley), Alice Agogino (Berkeley), Ras Bodik (Washington), Armando Fox (Berkeley), Marti Hearst (Berkeley), Tovi Grossman (Autodesk), George Fitzmaurice (Autodesk), Jan Borchers (RWTH Aachen), Steven Dow (CMU), Yang Li (Google), Kurt Luther (CMU), Scott Klemmer (PhD advisor - Stanford), Tony DeRose (Pixar), Michel Beaudouin-Lafon (Univ. Paris), Wendy Mackay (INRIA), Lora Oehlberg (INRIA), Wesley Willett (INRIA), Mira Dontcheva (Adobe), Wilmot Li (Adobe), Gautham Mysore (Adobe), Dan Goldman (Adobe), Sean Follmer (Stanford), Loris D'Antoni (Madison), Rajeev Alur (UPenn), Mahesh Viswanathan (UIUC), Sumit Gulwani (MSR).