I am a professor at EECS Department at
UC Berkeley, where I am part of
the
Berkeley Artificial Intelligence
Research Lab (BAIR).
Before that, I spent a decade on the
faculty of the
Robotics Institute at CMU. I am also
still remembered
in lovely
Oxford, where I did a post-doc
with Andrew Zisserman.
During 2007-2015, I have also been closely collaborating with
Team WILLOW
at École Normale Supérieure /
INRIA
in
beautiful Paris. Over the years, I was lucky to have some amazing
officemates.
Research
The central goal of my research is to use vast amounts of unlabelled
visual data to understand, model, and recreate the visual world around
us. My research has been mainly in data-driven computer vision, as well as its
projection onto computer graphics and computational photography. In the
last five years, my lab has been at the forefront of reviving
self-supervised learning. Other interests include human vision, visual data
mining,
robotics, and the applications of computer vision to the visual arts and
the humanities. I also enjoy making scientific
bets.
For a high-level overview of my research,
see my Heidelberg Forum talk on "Self-Supervised
Visual Learning and Synthesis", or, for a more technical talk, see "Self-supervision,
Meta-supervision, Curiosity: Making Computers Study Harder".
Or, for something completely different, check out a (somewhat dated)
New
Yorker article about some of our work. Also, I was doing vision-based
robotics before
it was cool (see picture on page 23 :).
I (try to) practice Slow
Science.
I
support Ukraine in its fight against
tyranny.
Postdocs
Graduate Students
Alumni
-
Former PhD Students
-
Dr. Dave Epstein (PhD 2024), now reserach scientist at Anthropic
PhD Thesis:
Disentangled Visual Generative Models
Soros
Fellowship
-
Dr. Allan Jabri (PhD 2023), now research scientist at OpenAI
PhD Thesis:
Scalable
Binding
Soros
Fellowship
-
Dr. Yu Sun (PhD 2023, co-advised with Moritz
Hardt), now postdoc at Stanford
PhD Thesis:
Test-Time
Training
-
Dr. Bill Peebles (PhD 2023),
now research scientist at OpenAI
PhD Thesis:
Generative
Models of Images and Neural Networks
NSF Fellowship
-
Dr. Tim Brooks (PhD 2023),
now research scientist at OpenAI
PhD Thesis:
Generative
Models for Image and Long Video Synthesis
NSF Fellowship
-
Dr. Taesung Park (PhD 2021), now
research scientist at Adobe
PhD Thesis:
Machine Learning for Deep Image Synthesis
Samsung Fellowship
Adobe Fellowship
-
Dr. Shiry Ginosar
(PhD 2020), now postdoc at UC Berkeley
PhD Thesis:
Modeling
Visual Minutiae: Gestures, Styles, and Temporal
Patterns
NSF Fellowship
Samuel Silver Memorial Scholarship Award
NSF Computing Innotation Fellow
-
Dr. Deepak Pathak
(PhD 2019, co-advised with Trevor Darrell), now
assistant professor at CMU
PhD Thesis:
Learning to Generalize via Self-Supervised Prediction
Facebook Fellowship
NVIDIA Fellowship
- Dr. Tinghui
Zhou (PhD 2018), now Engineering Manager at Roblox
PhD Thesis:
Visual Learning beyond Direct Supervision
-
Dr. Richard Zhang (PhD 2018), now senior research scientist at
Adobe
PhD Thesis:
Image Synthesis for Self-Supervised Visual Representation Learning
Adobe Fellowship
-
Dr. Jun-Yan Zhu
(PhD 2017), now assistant professor at CMU
PhD Thesis:
Learning to Synthesize and Manipulate Natural Images
Facebook Fellowship
Recipient of SIGGRAPH
Outstanding Doctoral Dissertation
Award
-
Dr. Ting-Chun
Wang (PhD 2017, co-advised with Ravi
Ramamoorthi), now principal research scientist at NVIDIA
PhD Thesis:
Beyond Photo-Consistency: Shape, Reflectance, and Material
Estimation Using Light-Field Cameras
Berkeley Fellowship
- Dr. Carl Doersch (MLD, PhD
2016, co-advised with
Abhinav Gupta), now
senior research scientist at
Google DeepMind
PhD Thesis: Supervision
Beyond Manual Annotations for Learning
Visual
Representations
Google Graduate Fellow
NDSEG Graduate Fellow
- Dr. Santosh Kumar
Divvala (Robotics, PhD 2012,
co-advised with Martial Hebert), now research
scientisit at Allen Institute for Artificial Intelligence (AI2)
PhD Thesis:
Context
and Subcategories for Sliding Window Object
Recognition
- Dr. Tomasz Malisiewicz
(Robotics, PhD 2011), now Research Scientist Manager at Meta Reality Labs
PhD Thesis:
Exemplar-based Representations for
Object Detection, Association and Beyond
NSF Graduate Fellow
- Dr.
Jean-François
Lalonde (Robotics, PhD 2011, co-advised with Srinivas Narasimhan),
now professor at Université Laval
PhD Thesis:
Understanding and Recreating Visual Appearance Under Natural Illumination
Microsoft Graduate Fellow
Recipient of
CMU School of Computer Science Distinguished Dissertation
Award
-
Dr. James Hays
(CSD, PhD 2009), now associate professor at Georgia Tech
PhD Thesis:
Large Scale
Scene Matching for Graphics and Vision
NSF Graduate Fellow
-
Dr. Derek Hoiem
(Robotics, PhD 2007, co-advised with Martial Hebert),
now professor at University of Illinois
PhD Thesis:
Seeing the World Behind the Image: Spatial Layout for 3D Scene
Understanding
Microsoft Graduate Fellow
Recipient of
CMU School of Computer Science Distinguished Dissertation
Award
Recipient of
ACM Doctoral Dissertation Honorable Mention
Former Postdocs
- Xiaolong Wang
(2019-2020, co-advised with
Trevor Darrell), now
assistant professor at UC San Diego
- Lerrel Pinto (2019-2020,
co-advised with Pieter
Abbeel), now assistant professor at NYU
- Andrew Owens (2016-2019,
co-advised with
Jitendra
Malik), now assistant professor at University of Michigan
- Angjoo
Kanazawa (2017-2019, co-advised with Jitendra
Malik and Trevor Darrell), now
assistant professor at UC Berkeley
- Dinesh
Jayaraman (2017-2019, co-advised with Sergey
Levine), now assistant professor at UPenn
- David Fouhey
(2016-2018, co-advised with Jitendra
Malik), now assistant professor at University of Michigan
- Judy Hoffman
(2017-2018, co-advised with Trevor
Darrell), now assistant professor at Georgia Tech
- Phillip Isola (2015-2017),
now
associate professor at MIT
- Philipp
Krähenbühl
(2014-2016, co-advised with
Jitendra Malik), now
associate professor at UT Austin
- Mathieu Aubry
(2015), now faculty at École des Ponts ParisTech
- Yong Jae Lee
(2012-2014), now associate professor at University of Wisconsin, Madison
-
Olivier Duchenne (fall
2012), now serial startup founder
- Ali Farhadi
(2011-2012,
co-advised with Martial
Hebert),
now professor at University of Washington
- Abhinav
Gupta (2009-2011,
co-advised with Martial
Hebert),
now professor at CMU
Former MS/BS Students and Visitors
-
Sheng-Yu Wang (BS 2019);
Caroline Chan (BS
2018);
Andrew Liu (MS 2018);
Tongzhou Wang (BS 2017);
Jacob Huh (BS 2016);
Krishna Kumar Singh
(MS 2015);
Kate Rakelly (BS
2015);
Achal Dave (BS
2015);
Tinghui
Zhou
(MS 2012); Abhinav
Shrivastava (MS 2011); Saurabh
Singh (MS 2011);
Danielle
Millett (BS
2009);
Suporn
Pongnumkul (BS 2005)
- Lab Visitors:
Sophia Koepke (spring 2024),
Yannis Siglidis (summer
2023, Summer 2024),
Jan Koenderink (fall 2018),
Petr
Gronat (spring 2016),
Mohammad
Rastegari
(summer 2015),
Qixing Huang (summer
2015),
Stefan Lee (summer
2014),
Dinesh Jayaraman
(summer 2014),
Sarah
Sachs (summer 2014),
Ekaterina Zaytseva (fall 2013),
Vincent
Delaitre (fall 2012),
Jose Ribelles (fall 2007)
Teaching
-
CS 180/280A: Intro to Computer Vision and
Computational Photography
[Fall'24,
Fall'23,
Fall'22,
Fall'21,
Fall'20,
Sp'20,
Fall'18,
Fall'17,
Fall'16,
Fall'15,
Fall'12,
Fall'11,
Fall'10,
Sp'10,
Fall'08,
Fall'07,
Fall'06,
Fall'05,
Fall'04]
- CS 280: Graduate
Computer Vision [Sp'24,Sp'23,Sp'21,Sp'19,Sp'18,
Sp'17,
Sp'16,
Fall'13]
- CS 294-192: Visual
Scene Understanding (Spring 2022)
- CS 189: Intro to Machine Learning [
Fall'15,
Sp'15,
Sp'14]
-
CS 294-43: Visual Object and Activity Recognition [Fall'14--Fall'18]
-
16-899A: Pixels to Percepts: Human Visual Perception
for Vision and Graphics [Spring'11]
- 16-824: Learning-based Methods in Vision
[
Sp'12,
Sp'09,
Sp'07,
Sp'06]
Publications
See also my Google Scholar profile for the
most
recent
publications as well as the most-cited
papers (which are quite different from my self-selected key
publications).
|
Diffusion Models as Data Mining Tools
Ioannis Siglidis,
Aleksander Holynski,
Alexei A. Efros,
Mathieu Aubry,
Shiry Ginosar
in ECCV 2024
|
|
Disentangled 3D Scene Generation with Layout Learning
Dave Epstein,
Ben Poole,
Ben Mildenhall,
Alexei A. Efros,
Aleksander Holynski
in ICML 2024
|
|
Sequential Modeling Enables Scalable Learning for
Large Vision Models
Yutong Bai,
Xinyang Geng,
Karttikeya Mangalam,
Amir Bar,
Alan Yuille,
Trevor Darrell,
Jitendra Malik,
Alexei A. Efros
in CVPR 2024
|
|
COLMAP-Free 3D Gaussian Splatting
Yang Fu,
Sifei Liu,
Amey Kulkarni,
Jan Kautz,
Alexei A. Efros,
Xiaolong Wang
in CVPR 2024
Watch the video
|
|
Interpreting CLIP's Image Representation
via Text-Based Decomposition
Yossi
Gandelsman,
Alexei A. Efros,
Jacob Steinhardt
in ICLR 2024
Code
available on
GitHub
|
|
Idempotent Generative Network
Assaf Shocher,
Amil Dravid,
Yossi
Gandelsman,
Inbar Mosseri,
Michael
Rubinstein,
Alexei A. Efros
in ICLR 2024
|
|
Differentiable Blocks World:
Qualitative 3D Decomposition by Rendering Primitives
Tom Monnier,
Jake Austin,
Angjoo Kanazawa,
Alexei A. Efros,
Mathieu Aubry
in NeurIPS 2023
Code
available on
GitHub
|
|
Diffusion Self-Guidance for Controllable Image Generation
Dave Epstein,
Allan Jabri,
Ben Poole,
Alexei A. Efros,
Aleksander Holynski
in NeurIPS 2023
|
|
Evaluating Data Attribution for Text-to-Image Models
Sheng-Yu Wang,
Alexei A. Efros,
Jun-Yan Zhu,
Richard Zhang
in ICCV 2023
|
|
Rosetta Neurons: Mining the Common Units in a Model Zoo
Amil Dravid,
Yossi
Gandelsman,
Alexei A. Efros,
Assaf Shocher
in ICCV 2023
Code
available on
GitHub
|
|
Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions
Ayaan Haque,
Matthew Tancik,
Alexei A. Efros,
Aleksander Holynski,
Angjoo Kanazawa
in ICCV 2023
Code
available
|
|
Internet Explorer: Targeted Representation Learning on the Open
Web
Alex Li,
Ellis Brown,
Alexei A. Efros,
Deepak Pathak
in ICML 2023
Code and models are available.
|
|
InstructPix2Pix: Learning to Follow Image Editing Instructions
Tim Brooks,
Aleksander Holynski,
Alexei A. Efros
in CVPR 2023
Code and
demo
available
|
|
Putting People in Their Place:
Affordance-Aware Human Insertion into Scenes
Sumith Kulal,
Tim Brooks,
Alex Aiken,
Jiajun Wu,
Jimei Yang,
Jingwan Lu,
Alexei A. Efros,
Krishna Kumar Singh
in CVPR 2023
Code available on GitHub
|
|
GLaD: Generalizing Dataset Distillation
via Deep Generative Prior
George Cazenavette,
Tongzhou Wang,
Antonio Torralba,
Alexei A. Efros,
Jun-Yan Zhu
in CVPR 2023
Code available on GitHub
|
|
Visual Prompting via Image Inpainting
Amir Bar,
Yossi Gandelsman,
Trevor Darrell,
Amir Globerson,
Alexei A. Efros
in NeurIPS 2022
Code available on
GitHub
|
|
Test-Time Training with Masked Autoencoders
Yossi Gandelsman,
Yu Sun,
Xinlei Chen,
Alexei A. Efros
in NeurIPS 2022
Code
available on GitHub
|
|
Generating Long Videos of Dynamic Scenes
Tim Brooks,
Janne
Hellsten,
Miika Aittala,
Ting-Chun Wang,
Timo Aila,
Jaakko Lehtinen,
Ming-Yu Liu,
Alexei A. Efros,
Tero Karras
in NeurIPS 2022
Code and models
available on GitHub
|
|
BlobGAN: Spatially Disentangled Scene Representations
Dave Epstein,
Taesung Park,
Richard Zhang,
Eli
Shechtman,
Alexei A. Efros
in ECCV 2022
Watch video
Code available on
GitHub
CoLab
Demo
|
|
Hallucinating Pose-Compatible Scenes
Tim Brooks,
Alexei A. Efros
in ECCV 2022
Code and
models available on GitHub
Watch video
|
|
Share With Thy Neighbors: Single-View Reconstruction by
Cross-Instance Consistency
Tom Monnier,
Matt Fisher,
Alexei A. Efros,
Mathieu Aubry
in ECCV 2022
Code available on
GitHub
Watch
Video
|
|
Understanding Collapse in Non-Contrastive Siamese
Representation Learning
Alex Li,
Alexei A. Efros,
Deepak Pathak
in ECCV 2022
|
|
Studying Bias in GANs through the Lens of Race
Vongani
Maluleke,
Neerja Thakkar,
Tim Brooks,
Ethan Weber,
Trevor Darrell,
Alexei A. Efros,
Angjoo Kanazawa,
Devin Guillory
in ECCV 2022
|
|
Dataset Distillation by Matching Training Trajectories
George Cazenavette,
Tongzhou Wang,
Antonio Torralba,
Alexei A. Efros,
Jun-Yan Zhu
in CVPR'22
Code
available on
GitHub
|
|
GAN-Supervised Dense Visual Alignment
William Peebles,
Jun-Yan Zhu,
Richard Zhang,
Antonio
Torralba
Alexei A. Efros,
Eli
Shechtman
in CVPR'22
Watch video
code
available on
GitHub
mixed reality demo
|
|
Learning Pixel Trajectories with Multiscale Contrastive Random
Walks
Zhangxing Bian,
Allan Jabri,
Alexei A. Efros,
Andrew Owens
in CVPR'22
Code available on
GitHub
|
|
MarioNette: Self-Supervised Sprite Learning
Dmitriy Smirnov,
Michael Gharbi,
Matt Fisher,
Vitor Guizilini,
Alexei A. Efros,
Justin Solomon
in NeurIPS 2021
Code
avaiable on GitHub
Watch the video
|
|
Video Autoencoder: self-supervised disentanglement of static 3D
structure and motion
Zihang Lai,
Sifei Liu,
Alexei A. Efros,
Xiaolong Wang
in ICCV 2021
Code
avaiable on GitHub
Watch the video
|
|
Few-shot Image Generation via Cross-domain Correspondence
Utkarsh Ojha,
Yijun Li,
Jingwan Lu,
Alexei A. Efros,
Yong Jae Lee,
Eli
Shechtman,
Richard Zhang
in CVPR 2021
Code
avaiable on GitHub
Watch the video
|
|
Learning Cross-Domain Correspondence for Control with Dynamics
Cycle-Consistency
Qiang Zhang,
Tete Xiao,
Alexei A. Efros,
Lerrel Pinto,
Xiaolong Wang
in ICLR 2021
Code available on
GitHub
Watch the video
|
|
Self-Supervised Policy Adaptation
during Deployment
Nicklas Hansen,
Rishabh Jangir,
Yu Sun,
Guillem AlenyĆ ,
Pieter Abbeel,
Alexei A. Efros,
Lerrel Pinto,
Xiaolong Wang
in ICLR 2021
Code aviable on GitHub
Watch the video
|
|
What Should Not Be Contrastive in Contrastive Learning
Tete Xiao,
Xiaolong Wang,
Alexei A. Efros,
Trevor Darrell
in ICLR 2021
Watch the video
|
|
Space-Time Correspondence as a Contrastive Random Walk
Allan Jabri,
Andrew Owens,
Alexei A. Efros
in Neural Information Processing Systems 2020
Code available on
GitHub
Watch 12 min video
|
|
Swapping Autoencoder for Deep Image Manipulation
Taesung Park,
Jun-Yan Zhu,
Oliver Wang,
Jingwan (Cynthia) Lu,
Eli
Shechtman,
Alexei A. Efros,
Richard Zhang
in Neural Information Processing Systems 2020
Watch 3 min video
code
available on
GitHub
|
|
Learning to Factorize and Relight a City
Andrew Liu,
Shiry Ginosar,
Tinghui Zhou,
Alexei A. Efros,
Noah Snavely
in ECCV 2020
Code
available on GitHub
Watch 90 sec video
|
|
Contrastive Learning for Unpaired Image-to-Image Translation
Taesung Park,
Alexei A. Efros,
Richard Zhang,
Jun-Yan Zhu
in ECCV 2020
Watch 1 min video
code
available on
GitHub
|
|
RANSAC-Flow: generic two-stage image alignment
Xi Shen,
François
Darmon,
Alexei A. Efros,
Mathieu Aubry
in ECCV 2020
Watch 90 sec video
Results video
Code available on
GitHub
|
|
The Hessian Penalty: a Weak Prior for Unsupervised
Disentanglement
William Peebles,
John Peebles,
Jun-Yan Zhu,
Alexei A. Efros,
Antonio
Torralba
in ECCV 2020
Watch 90 sec video
code
available on
GitHub
|
|
Test-Time Training with Self-Supervision for Generalization
under Distribution Shifts
Yu Sun,
Xiaolong Wang,
Zhuang Liu,
John Miller,
Alexei A. Efros,
Moritz Hardt
in ICML 2020
Video of ICML talk
|
|
CNN-generated images are surprisingly easy to spot... for now
Sheng-Yu Wang,
Oliver Wang,
Richard Zhang,
Andrew Owens,
Alexei A. Efros
in CVPR 2020
Video of
CVPR talk
Code avaiable on GitHub
|
|
Learning to Control Self-Assembling Morphologies:
A Study of Generalization via Modularity
Deepak Pathak,
Chris Lu,
Trevor Darrell,
Phillip
Isola,
Alexei A. Efros
in NIPS'19
Winner of Virtual Creatures
Competition at GECCO 2019.
Watch the video
Code available on GitHub
|
|
Detecting Photoshopped Faces by Scripting Photoshop
Sheng-Yu Wang,
Oliver Wang,
Andrew Owens,
Richard Zhang,
Alexei A. Efros
in ICCV'19
Watch the
video
Code avaiable on GitHub
|
|
Interactive Sketch & Fill: Multiclass Sketch-to-Image
Translation
Arnab Ghosh,
Richard Zhang,
Puneet Dokaria,
Oliver Wang,
Alexei A. Efros,
Phillip Torr,
Eli
Shechtman
in ICCV'19
Watch the
video
Code avaiable on GitHub
|
|
Everybody Dance Now
Caroline Chan,
Shiry Ginosar,
Tinghui Zhou,
Alexei A. Efros
in ICCV'19
Watch the video
Code avaiable on GitHub
Check out the new Sway: Magic Dance
iphone app!
|
|
Multi-view Relighting Using a
Geometry-Aware Network
Julien
Philip,
Michael
Gharbi,
Tinghui Zhou,
Alexei A. Efros and
George
Drettakis
in SIGGRAPH 2019
Watch project video
|
|
Learning Correspondence from the Cycle-Consistency of Time
Xiaolong Wang,
Allan Jabri,
Alexei A. Efros
in CVPR 2019
Watch project
video
Code available on GitHub
|
|
Discovering Visual Patterns in Art Collections with
Spatially-consistent Feature Learning
Xi Shen,
Alexei A. Efros,
Mathieu Aubry
in CVPR 2019
Code available on GitHub
|
|
Large-Scale Study of Curiosity-Driven Learning
Yuri Burda,
Harri Edwards,
Deepak Pathak,
Amos Storkey,
Trevor Darrell,
Alexei A. Efros
in ICLR'19
Watch the video
Code avaiable on
GitHub
|
|
Time-Agnostic Prediction:
Predicting Predictable Video Frames
Dinesh
Jayaraman,
Frederik Ebert,
Alexei A. Efros,
Sergey Levine
in ICLR'19
|
|
Dataset Distillation
Tongzhou Wang,
Jun-Yan Zhu,
Antonio Torralba,
Alexei A. Efros
unpublished (arXiv, 2018)
Code available on
GitHub
|
|
Fighting Fake News: Image Splice Detection via Learned
Self-Consistency
Minyoung Huh,
Andrew Liu,
Andrew Owens,
Alexei A. Efros
in ECCV'18
Watch the video
Code available on
GitHub
|
|
Audio-Visual Scene Analysis with Self-Supervised Multisensory
Features
Andrew Owens,
Alexei A. Efros
in ECCV'18
Watch the video
Code available on
GitHub
|
|
Improving Generalization via Scalable Neighborhood Component
Analysis
Zhirong
Wu,
Alexei A. Efros,
Stella Yu
in ECCV'18
Code available on
GitHub
|
|
Learning Category-Specific Mesh Reconstruction
from Image Collections
Angjoo Kanazawa,
Shubham
Tulsiani,
Alexei A. Efros,
Jitendra Malik
in ECCV'18
Watch the video
Code avaiable on GitHub
|
|
Investigating Human Priors for Playing Video Games
Rachit Dubey,
Pulkit Agrawal,
Deepak Pathak,
Tom Griffiths,
Alexei A. Efros
in ICML'18
Watch Arxiv
Insights episode covering our paper
Get in touch with your inner RL agent: play our super-hard
platformer game
|
|
The Unreasonable Effectiveness of Deep Features as a Perceptual
Metric
Richard Zhang,
Phillip Isola,
Alexei A. Efros,
Eli
Shechtman,
Oliver Wang
in CVPR'18
code available
on
GitHub
|
|
Multi-view Consistency as Supervisory Signal for Learning Shape
and Pose Prediction
Shubham
Tulsiani,
Alexei A. Efros,
Jitendra Malik
in CVPR'18
code available
on
GitHub
|
|
From Lifestyle VLOGs to Everyday Interactions
David Fouhey,
Weicheng Kuo,
Alexei A. Efros,
Jitendra Malik
in CVPR'18
dataset
available
on online
|
|
Factoring Shape, Pose, and Layout
from the 2D Image of a 3D Scene
Shubham
Tulsiani,
Saurabh Gupta,
David Fouhey,
Alexei A. Efros,
Jitendra Malik
in CVPR'18
code available
on
GitHub
|
|
Zero-Shot Visual Imitation
Deepak Pathak,
Parsa Mahmoudieh,
Guanghao Luo,
Pulkit Agrawal,
Dian Chen,
Yide Shentu,
Evan Shelhamer,
Jitendra Malik,
Alexei A. Efros,
Trevor Darrell
in ICLR'18
code
available on
GitHub
|
|
3D Sketching using Multi-View
Deep Volumetric Prediction
Johanna Delanoy,
Mathieu Aubry,
Phillip Isola,
Alexei A. Efros,
Adrien Bousseau
in I3D 2018
Watch
video
|
|
Toward Multimodal Image-to-Image Translation
Jun-Yan Zhu,
Richard Zhang,
Deepak Pathak,
Trevor Darrell,
Alexei A. Efros,
Oliver Wang,
Eli
Shechtman
in NIPS'17
code available on
GitHub
Watch video
|
|
Unpaired Image-to-Image Translation using Cycle-Consistent
Adversarial Networks
Jun-Yan Zhu,
Taesung Park,
Phillip Isola,
Alexei A. Efros
in ICCV'17
code available on
GitHub
Watch ICCV spotlight
talk
|
|
Curiosity-driven Exploration by Self-supervised Prediction
Deepak Pathak,
Pulkit Agrawal,
Alexei A. Efros,
Trevor Darrell
in ICML'17
code
available on
GitHub
Watch video
|
|
Real-Time User-Guided Image Colorization with Learned Deep
Priors
Richard Zhang,
Jun-Yan Zhu,
Phillip Isola,
Xinyang Geng,
Angela S. Lin, Tianhe Yu,
Alexei A. Efros
in SIGGRAPH'17
code
available on
GitHub
Watch video
|
|
Light Field Video Capture Using a Learning-Based Hybrid Imaging
System
Ting-Chun
Wang,
Jun-Yan Zhu,
Nima Khademi Kalantari,
Alexei A. Efros,
Ravi Ramamoorthi
in SIGGRAPH'17
code
available on
GitHub
Watch video
|
|
Image-to-Image Translation with Conditional Adversarial Nets
Phillip Isola,
Jun-Yan Zhu,
Tinghui Zhou,
Alexei A. Efros
in CVPR'17
code available on
GitHub
Check out some neat/crazy uses of our software on twitter:
#pix2pix
|
|
Split-Brain Autoencoders:
Unsupervised Learning by Cross-Channel Prediction
Richard Zhang,
Phillip Isola,
Alexei A. Efros
in CVPR'17
code available on
GitHub
|
|
Multi-view Supervision for Single-view Reconstruction
via Differentiable Ray Consistency
Shubham
Tulsiani,
Tinghui Zhou,
Alexei A. Efros,
Jitendra Malik
in CVPR'17
code available
on
GitHub
|
|
Learning Shape Abstractions by Assembling Volumetric Primitives
Shubham
Tulsiani,
Hao Su,
Leonidas Guibas,
Alexei A. Efros,
Jitendra Malik
in CVPR'17
code available
on
GitHub
|
|
BUILDUP: Interactive Creation of Urban Scenes
from Large Photo Collections
Jose Ribelles,
Diego Gutierrez,
Alexei A. Efros
Multimedia Tools and Applications, 2017
Watch the video
|
|
What makes ImageNet good for transfer learning?
Jacob Huh,
Pulkit Agrawal,
Alexei A. Efros
in NIPS Workshop on Large Scale Computer Vision Systems (2016)
|
|
Colorful Image Colorization
Richard Zhang,
Phillip Isola,
Alexei A. Efros
in ECCV'16
code available on
GitHub
|
|
View Synthesis by Appearance Flow
Tinghui Zhou,
Shubham
Tulsiani,
Weilun Sun,
Jitendra Malik,
Alexei A. Efros
in ECCV'16
code available on
GitHub
|
|
Generative Visual Manipulation on the Natural Image Manifold
Jun-Yan Zhu,
Philipp
Krähenbühl,
Eli
Shechtman,
Alexei A. Efros
in ECCV'16
code available on GitHub
|
|
Learning Dense Correspondence via 3D-guided
Cycle Consistency
Tinghui Zhou,
Philipp
Krähenbühl,
Mathieu Aubry,
Qixing Huang,
Alexei A. Efros
in CVPR'16
code and models available
|
|
Context Encoders: Feature Learning by Inpainting
Deepak Pathak,
Philipp
Krähenbühl,
Jeff Donahue,
Trevor Darrell,
Alexei A. Efros
in CVPR'16
code available on
GitHub
|
|
SVBRDF-Invariant Shape and Reflectance Estimation from
Light-Field Cameras
Ting-Chun
Wang,
Manmohan Chandraker,
Alexei A. Efros,
Ravi Ramamoorthi
in CVPR'16
|
|
KrishnaCam: Using a Longitudinal, Single-Person, Egocentric
Dataset for Scene Understanding Tasks
Krishna Kumar Singh,
Kayvon Fatahalian,
Alexei A. Efros
in WACV 2016
Full egocentric dataset now available!
|
|
Post-Post-Modern Photography: Capture-Time Perceptual
Matching For More Faithful Photographs
Rachel Albert,
Alexei A. Efros
UCB Tech Report, 2016
|
|
A Century of Portraits:
A Visual Historical Record of American High School Yearbooks
Shiry Ginosar,
Kate Rakelly,
Sarah Sachs,
Brian Yin,
Alexei A. Efros
in ICCV'15 Extreme Imaging Workshop
See article
in the Washington Post
|
|
Unsupervised Visual Representation Learning by Context
Prediction
Carl Doersch,
Abhinav Gupta,
Alexei A. Efros
in ICCV'15
code available on
GitHub
|
|
Learning Data-driven Reflectance Priors for Intrinsic Image
Decomposition
Tinghui Zhou,
Philipp
Krähenbühl,
Alexei A. Efros
in ICCV'15
code available on
GitHub
|
|
Learning a Discriminative Model for the Perception of Realism
in Composite Images
Jun-Yan Zhu,
Philipp
Krähenbühl,
Eli
Shechtman,
Alexei A. Efros
in ICCV'15
|
|
Occlusion-aware Depth Estimation Using Light-field Cameras
Ting-Chun
Wang,
Alexei A. Efros,
Ravi Ramamoorthi
in ICCV'15
|
|
Unifying Color and Texture Transfer for Predictive Appearance
Manipulation
Fumio Okura,
Kenneth Vanhoey,
Adrien Bousseau,
Alexei A. Efros and
George
Drettakis
in EGSR 2015
|
|
FlowWeb: Joint Image Set Alignment by Weaving Consistent,
Pixel-wise Correspondences
Tinghui Zhou,
Yong Jae Lee,
Stella Yu, and
Alexei A. Efros
in CVPR 2015
|
|
Linking past to present: Discovering style in two centuries of
architecture
Stefan Lee,
Nicolas Maisonneuve,
David Crandall,
Alexei A. Efros, and
Josef Sivic
in International Conference on Computational Photography (ICCP
2015)
|
|
Mirror Mirror: Crowdsourcing Better Portraits
Jun-Yan Zhu,
Aseem Agarwala,
Alexei A. Efros,
Eli
Shechtman,
Jue Wang
in SIGGRAPH Asia 2014
Watch video.
|
|
City Forensics: Using Visual Elements to Predict Non-Visual
City Attributes
Sean Arietta,
Alexei A. Efros,
Maneesh Agrawala,
Ravi Ramamoorthi
in IEEE Transactions on Visualization and Computer Graphics
(TVCG 2014)
Best Paper Honorable Mention
|
|
Context as Supervisory Signal:
Discovering Objects with Predictable Context
Carl Doersch,
Abhinav Gupta,
Alexei A. Efros
in ECCV 2014
|
|
AverageExplorer: Interactive Exploration and Alignment of Visual
Data Collections
Jun-Yan Zhu,
Yong Jae Lee, and
Alexei A. Efros
in SIGGRAPH 2014
Watch the video
See article
in The New Yorker
|
|
3D Object Manipulation in a Single Photograph using Stock 3D
Models
Natasha Kholgade,
Tomas Simon,
Alexei A. Efros, and
Yaser Sheikh
in SIGGRAPH 2014
Watch the video
See article
in New York Times
|
|
Seeing 3D chairs: exemplar part-based 2D-3D alignment using a
large dataset of CAD models
Mathieu Aubry,
Daniel Maturana,
Alexei A. Efros,
Bryan Russell,
Josef Sivic
in CVPR 2014
Watch the video
|
|
Style-aware Mid-level Representation for Discovering
Visual Connections in Space and Time
Yong Jae Lee,
Alexei A. Efros,
Martial Hebert
in ICCV 2013
Watch the presentation
Source code available
Expanded book
chapter
|
|
Mid-Level Visual Element Discovery as Discriminative Mode
Seeking
Carl Doersch,
Abhinav Gupta,
Alexei A. Efros
in NIPS 2013
Source code
available
|
|
What makes Paris look like Paris?
Carl Doersch,
Saurabh
Singh,
Abhinav Gupta,
Josef Sivic,
Alexei A. Efros
in SIGGRAPH 2012
Source code
available
Watch the video
Republished in Communications of the ACM
article,
with a forward
by Noah Snavely and a video.
|
|
Unsupervised Discovery of Mid-Level Discriminative Patches
Saurabh
Singh,
Abhinav Gupta,
Alexei A. Efros
in ECCV 2012
Source code available
|
|
People Watching: Human Actions as a Cue for Single View
Geometry
David Fouhey,
Vincent Delaitre,
Abhinav Gupta,
Alexei A. Efros,
Ivan Laptev,
Josef Sivic
in ECCV 2012
Watch the video
Extended Journal
Version in IJCV 2014
|
|
Scene Semantics from Long-term Observation of People
Vincent Delaitre,
David Fouhey,
Ivan Laptev,
Josef Sivic
Abhinav Gupta,
Alexei A. Efros
in ECCV 2012
|
|
Dating Historical Color Images
Frank Palermo,
James Hays,
Alexei A. Efros
in ECCV 2012
Partial source code
available
|
|
Object Instance Sharing by Enhanced
Bounding Box Correspondence
Santosh Kumar Divvala,
Alexei A. Efros,
Martial Hebert
in BMVC 2012
|
|
Data-driven Visual Similarity for Cross-domain Image Matching
Abhinav Shrivastava,
Tomasz Malisiewicz,
Abhinav Gupta,
Alexei A. Efros
in SIGGRAPH Asia 2011
Watch the video
|
|
Ensemble of Exemplar-SVMs for Object Detection and Beyond
Tomasz Malisiewicz,
Abhinav Gupta,
Alexei A. Efros
in ICCV 2011
Source code available
ICML'12 invited applications talk
(see Extended
Abstract)
|
|
From 3D Scene Geometry to Human Workspace
Abhinav Gupta,
Scott Satkin,
Alexei A. Efros,
Martial Hebert
in CVPR 2011
Watch video
|
|
Unbiased Look at Dataset Bias
Antonio Torralba,
Alexei A. Efros
in CVPR 2011
|
|
Blocks World Revisited: Image Understanding using Qualitative
Geometry and Mechanics
Abhinav Gupta,
Alexei A. Efros,
Martial Hebert
in ECCV 2010
ECCV Best Paper Honorable Mention
Source code available
|
|
Detecting Ground Shadows
in Outdoor Consumer Photographs
Jean-François
Lalonde,
Alexei A. Efros,
Srinivasa G. Narasimhan
in ECCV 2010
Source code available
|
|
Beyond Categories: The Visual Memex Model for Reasoning About
Object Relationships
Tomasz Malisiewicz,
Alexei A. Efros
in NIPS 2009.
|
|
Segmenting Scenes by Matching Image Composites
Bryan Russell,
Alexei A. Efros,
Josef Sivic,
Bill Freeman,
Andrew Zisserman
in NIPS 2009
Source code available
|
|
Webcam Clip Art: Appearance and Illuminant Transfer from
Time-lapse Sequences
Jean-François
Lalonde,
Alexei A. Efros,
Srinivasa G. Narasimhan
in SIGGRAPH Asia 2009
Source code available
Watch the
video
|
|
Image Composition for Object Pop-out
Hongwen (Henry) Kang,
Alexei A. Efros,
Takeo
Kanade,
Martial Hebert
Workshop on 3D Representation for Recognition (3dRR-09) (at ICCV
2009)
|
|
Estimating Natural Illumination from a Single Outdoor Image
Jean-François
Lalonde,
Alexei A. Efros,
Srinivasa G. Narasimhan
in ICCV 2009
(see expanded journal version in IJCV 2012)
Source code available
|
|
Image Sequence Geolocation with Human Travel Priors
Evangelos Kalogerakis,
Olga Vesselova,
James Hays,
Alexei A. Efros,
Aaron Hertzmann
in ICCV 2009
|
|
An Empirical Study of Context in Object Detection
Santosh Kumar Divvala,
Derek Hoiem,
James Hays,
Alexei A. Efros,
Martial Hebert
in CVPR 2009
|
|
What Does the Sky Tell Us About the Camera?
Jean-François
Lalonde,
Srinivasa G. Narasimhan,
Alexei A. Efros.
in ECCV 2008
(see expanded
journal version, IJCV
2009)
Source code available
|
|
Can Similar Scenes help Surface Layout Estimation?
Santosh Kumar Divvala,
Alexei A. Efros,
Martial Hebert
in IEEE Workshop on Internet Vision (at CVPR'08)
|
|
Recognition by Association via Learning Per-exemplar Distances
Tomasz Malisiewicz,
Alexei A. Efros
in CVPR 2008.
Source code available
|
|
im2gps: estimating geographic information from a single image
James Hays,
Alexei A. Efros
in CVPR 2008.
Flickr download code
available
See
interview with Hays on Pittsburgh TV station. And
another one.
Extended version:
Large-Scale Image Geolocalization
|
|
Closing the Loop on Scene Interpretation
Derek Hoiem,
Alexei A. Efros,
Martial Hebert
in CVPR 2008.
See video.
|
|
Image-based Shaving
Minh Hoai
Nguyen,
Jean-François
Lalonde, Alexei A. Efros,
Fernando de la Torre
in Eurographics 2008.
|
|
Recovering Occlusion Boundaries from a Single Image
Derek Hoiem,
Andrew Stein,
Alexei A. Efros,
Martial Hebert
in ICCV 2007.
(see expanded journal
version in IJCV 2011)
Source code available
|
|
Using Color Compatibility for Assessing Image Realism
Jean-François
Lalonde,
Alexei A. Efros
in ICCV 2007.
|
|
Improving Spatial Support for Objects via Multiple Segmentations
Tomasz Malisiewicz,
Alexei A. Efros
in BMVC 2007.
|
|
Scene Completion using Millions of Photographs
James Hays,
Alexei A. Efros
in SIGGRAPH 2007.
Flickr download code
available
See article
on BBC News
See also Communications of the ACM
article with
forward by Marc Levoy
Named one of
seminal graphics
papers
|
|
Photo Clip Art
Jean-François
Lalonde,
Derek Hoiem,
Alexei Efros,
Carsten Rother,
John Winn,
Antonio Criminisi
in SIGGRAPH 2007.
Try the Live
Java Demo
Watch the
video
|
|
Putting Objects in Perspective
Derek Hoiem,
Alexei A. Efros,
Martial Hebert
In CVPR 2006.
Source code available
CVPR Best Paper Award
(see also expanded journal version, IJCV 2008)
|
|
Using Multiple Segmentations to Discover Objects and their
Extent in Image Collections
Bryan
Russell,
Alexei A. Efros,
Josef Sivic,
Bill Freeman,
Andrew Zisserman
in CVPR 2006
Source code
available
|
|
Discovering Texture Regularity as a Higher-Order Correspondence
Problem
James Hays,
Marius
Leordeanu,
Alexei A. Efros,
Yanxi Liu
in ECCV 2006
|
|
Geometric Context from a Single Image
Derek Hoiem,
Alexei A. Efros,
Martial Hebert
In ICCV 2005
(see also
expanded journal version, IJCV 2007)
Executable available
(for non-commerical use only)
|
|
Discovering Objects and their Location in Images
Josef Sivic,
Bryan Russell,
Alexei A. Efros,
Andrew Zisserman,
Bill Freeman
In ICCV 2005
Recepient of the test-of-time
Helmholtz
Prize
|
|
Automatic Photo Pop-up
Derek Hoiem,
Alexei A. Efros,
Martial Hebert
In SIGGRAPH 2005
See video.
See article in The Economist
|
|
A Data-Driven Approach to Quantifying Natural Human Motion
Liu Ren,
Alton Patrick,
Alexei A. Efros,
Jessica Hodgins.
James Rehg.
In SIGGRAPH 2005
|
|
Seeing
Through
Water
Alexei A. Efros,
Volkan Isler,
Jianbo Shi,
Mirko Visontai
In NIPS 17, 2004
Data available as
frames or
video
|
|
Recovering Human Body Configurations: Combining Segmentation and
Recognition
Greg Mori,
Xiaofeng Ren,
Alexei A. Efros,
Jitendra Malik
In CVPR 2004
|
|
Recognizing Action at a Distance
Alexei A. Efros,
Alexander Berg,
Greg Mori,
Jitendra Malik
In ICCV 2003
Watch the video
Recepient of the test-of-time
Helmholtz
Prize
|
|
Image Quilting for Texture Synthesis and Transfer
Alexei A. Efros,
Bill Freeman
In SIGGRAPH 2001
Source code available
Named one of
seminal graphics
papers
|
|
Texture Synthesis by Non-parametric Sampling
Alexei A. Efros,
Thomas
Leung
In ICCV 1999
Recepient of the test-of-time
Helmholtz
Prize
|
Funding Sources
My research group is funded from a range of sources, including
federal, state and other grants, fellowships to students, and industrial
gifts. Current funding comes from:
ONR MURI, NSF, Toyota Research Institute, and
Adobe. From time
to time, I
also engage in personal consulting activities for government and industry
entities.
Currently, I am consulting for Adobe
(2hr/week).
Misc.
|