Phillip Isola

p h i l l i p i @ m i t . e d u
Google Scholar / GitHub / Twitter

About me

I am currently a visiting research scientist at OpenAI. I will be starting as an assistant professor in EECS at MIT in the Fall of 2018.

Previously, I was a postdoctoral scholar with Alyosha Efros in the EECS department at UC Berkeley. I completed my Ph.D. in Brain & Cognitive Sciences at MIT, under the supervision of Ted Adelson, where I also frequently worked with Aude Oliva. I received my undergraduate degree in Computer Science from Yale, where I got my start on research working with Brian Scholl.

I study why we represent the world the way we do, and how we can replicate these abilities in machines.


▻ New blog post on our work on Evolved Policy Gradients.
▻ I am co-organizing a tutorial on GANs at CVPR 2018.


Evolved Policy Gradients
Rein Houthooft, Richard Y. Chen, Phillip Isola, Bradly C. Stadie, Filip Wolski, Jonathan Ho, Pieter Abbeel
arXiv 2018.
CyCADA: Cycle-Consistent Adversarial Domain Adaptation
Judy Hoffman, Eric Tzeng, Taesung Park, Jun-Yan Zhu, Phillip Isola, Kate Saenko, Alexei A. Efros, Trevor Darrell
arXiv 2018.
Memorable words are monogamous: The role of synonymy and homonymy in word recognition memory
Kyle Mahowald*, Phillip Isola*, Evelina Fedorenko, Edward Gibson, Aude Oliva
PsyArXiv 2018.
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Schechtman, Oliver Wang
CVPR 2018.
What You Sketch Is What You Get: 3D Sketching using Multi-View Deep Volumetric Prediction
Johanna Delanoy, Adrien Bousseau, Mathieu Aubry, Phillip Isola, Alexei A. Efros
I3D 2018.

Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
Jun-Yan Zhu*, Taesung Park*, Phillip Isola, Alexei A. Efros
ECCV 2017.
Combining Self-Supervised Learning and Imitation for Vision-Based Rope Manipulation
Ashvin Nair, Pulkit Agrawal, Dian Chen, Phillip Isola, Pieter Abbeel, Jitendra Malik, Sergey Levine
ICRA 2017.
Richard Zhang*, Jun-Yan Zhu*, Phillip Isola, Xinyang Geng, Angela S. Lin, Tianhe Yu, Alexei A. Efros
Real-Time User-Guided Image Colorization with Learned Deep Priors
Ali Jahanian, Phillip Isola, Donglai Wei
Mining Visual Evolution in 21 Years of Web Design
CHI Extended Abstract, 2017.
Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, Alexei A. Efros
Image-to-Image Translation with Conditional Adversarial Networks
CVPR, 2017.
Richard Zhang, Phillip Isola, Alexei A. Efros
Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction
CVPR, 2017.

Richard Zhang, Phillip Isola, Alexei A. Efros
Colorful Image Colorization
European Conference on Computer Vision (ECCV), 2016 (oral).
Andrew Owens, Phillip Isola, Josh McDermott, Antonio Torralba, Edward H. Adelson, William T. Freeman
Visually Indicated Sounds
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016 (oral).
[Paper][Website][Video][Dataset (50GB)]
Phillip Isola, Daniel Zoran, Dilip Krishnan, Edward H. Adelson
Learning Visual Groups From Co-occurrences in Space and Time
International Conference on Learning Representations, Workshop paper, 2016

Daniel Zoran, Phillip Isola, Dilip Krishnan, William T. Freeman
Learning Ordinal Relationships for Mid-Level Vision
International Conference on Computer Vision (ICCV), 2015.
Phillip Isola*, Joseph J. Lim*, Isola, P.*, Edward H. Adelson
Discovering States and Transformations in Image Collections
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015 (oral).
Zoya Bylinskii, Phillip Isola, Constance Bainbridge, Antonio Torralba, Aude Oliva
Intrinsic and Extrinsic Effects on Image Memorability
Vision Research, 2015.
Zhengdong Zhang, Phillip Isola, Edward H. Adelson
Sparkle Vision: Seeing the World through Random Specular Microfacets
4th IEEE International Workshop on Computational Cameras and Displays, 2015.

Phillip Isola, Daniel Zoran, Dilip Krishnan, Edward H. Adelson
Crisp Boundary Detection Using Pointwise Mutual Information
European Conference on Computer Vision (ECCV), 2014 (oral).
Phillip Isola, Jianxiong Xiao, Devi Parikh, Antonio Torralba, Aude Oliva
What Makes a Photograph Memorable?
Pattern Analysis and Machine Intelligence (PAMI), 2013.

Phillip Isola and Ce Liu
Scene Collaging: Analysis and Synthesis of Natural Images with Semantic Layers.
International Conference on Computer Vision (ICCV), 2013.
Michelle Borkin, Azalea Vo, Zoya Bylinskii, Phillip Isola, Shashank Sunkavalli, Aude Oliva, Hanspeter Pfister
What Makes a Visualization Memorable?
IEEE Transactions on Visualization and Computer Graphics (Infovis), 2013.
Wilma A. Bainbridge, Phillip Isola, Aude Oliva
The Intrinsic Memorability of Face Images.
Journal of Experimental Psychology: General, 2013.
Aude Oliva, Phillip Isola, Aditya Khosla, Wilma A. Bainbridge
What makes a picture memorable?
SPIE Newsroom Article, 2013.

Aditya Khosla*, Jianxiong Xiao*, Phillip Isola, Antonio Torralba, Aude Oliva
Image Memorability and Visual Inception.
SIGGRAPH Asia Technical Briefs (Invited Paper), 2012.
Forrester Cole, Phillip Isola, William T. Freeman, Fredo Durand, Edward H. Adelson
Shapecollage: Occlusion-aware, example-based shape interpretation.
European Conference on Computer Vision (ECCV), 2012.
Wilma A. Bainbridge*, Phillip Isola*, Idan Blank, Aude Oliva
Establishing a database for studying human face photograph memorability.
Proceedings of the Annual Conference of the Cognitive Sciences Society, 2012.

Phillip Isola, Devi Parikh, Antonio Torralba, Aude Oliva
Understanding the intrinsic memorability of images.
Advances in Neural Information Processing Systems (NIPS), 2011.
Phillip Isola, Jianxiong Xiao, Antonio Torralba, Aude Oliva
What makes an image memorable?
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011.

Nicholas B. Turk-Browne, Phillip Isola, Brian J. Scholl, Teresa A. Treat
Multidimensional visual statistical learning.
Journal of Experimental Psychology: Learning, Memory, and Cognition, 2008.