Phillip Isola

p h i l l i p i @ m i t . e d u
Google Scholar / GitHub / Twitter

About me

I am currently a visiting research scientist at OpenAI. I will be starting as an assistant professor in EECS at MIT in the Fall of 2018.

Previously, I was a postdoctoral scholar with Alyosha Efros in the EECS department at UC Berkeley. I completed my Ph.D. in Brain & Cognitive Sciences at MIT, under the supervision of Ted Adelson, where I also frequently worked with Aude Oliva. I received my undergraduate degree in Computer Science from Yale, where I got my start on research working with Brian Scholl.

I study why we represent the world the way we do, and how we can replicate these abilities in machines.


News

▻ New blog post on our work on Evolved Policy Gradients.
▻ I am co-organizing a tutorial on GANs at CVPR 2018.


Papers

2018
Evolved Policy Gradients
Rein Houthooft, Richard Y. Chen, Phillip Isola, Bradly C. Stadie, Filip Wolski, Jonathan Ho, Pieter Abbeel
arXiv 2018.
[Paper][Blog][Code]
CyCADA: Cycle-Consistent Adversarial Domain Adaptation
Judy Hoffman, Eric Tzeng, Taesung Park, Jun-Yan Zhu, Phillip Isola, Kate Saenko, Alexei A. Efros, Trevor Darrell
arXiv 2018.
[Paper]
Memorable words are monogamous: The role of synonymy and homonymy in word recognition memory
Kyle Mahowald*, Phillip Isola*, Evelina Fedorenko, Edward Gibson, Aude Oliva
PsyArXiv 2018.
[Paper]
The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Schechtman, Oliver Wang
CVPR 2018.
[Paper][Website][Code]
What You Sketch Is What You Get: 3D Sketching using Multi-View Deep Volumetric Prediction
Johanna Delanoy, Adrien Bousseau, Mathieu Aubry, Phillip Isola, Alexei A. Efros
I3D 2018.
[Paper][Video]

2017
Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks
Jun-Yan Zhu*, Taesung Park*, Phillip Isola, Alexei A. Efros
ECCV 2017.
[Paper][Website][Code]
Combining Self-Supervised Learning and Imitation for Vision-Based Rope Manipulation
Ashvin Nair, Pulkit Agrawal, Dian Chen, Phillip Isola, Pieter Abbeel, Jitendra Malik, Sergey Levine
ICRA 2017.
[Paper][Website][Video]
Richard Zhang*, Jun-Yan Zhu*, Phillip Isola, Xinyang Geng, Angela S. Lin, Tianhe Yu, Alexei A. Efros
Real-Time User-Guided Image Colorization with Learned Deep Priors
SIGGRAPH 2017.
[Paper][Website][Code][Video]
Ali Jahanian, Phillip Isola, Donglai Wei
Mining Visual Evolution in 21 Years of Web Design
CHI Extended Abstract, 2017.
[Paper]
Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, Alexei A. Efros
Image-to-Image Translation with Conditional Adversarial Networks
CVPR, 2017.
[Paper][Website][Code][Demo]
Richard Zhang, Phillip Isola, Alexei A. Efros
Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction
CVPR, 2017.
[Paper][Website][Code]

2016
Richard Zhang, Phillip Isola, Alexei A. Efros
Colorful Image Colorization
European Conference on Computer Vision (ECCV), 2016 (oral).
[Paper][Website][Code][Demo]
Andrew Owens, Phillip Isola, Josh McDermott, Antonio Torralba, Edward H. Adelson, William T. Freeman
Visually Indicated Sounds
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016 (oral).
[Paper][Website][Video][Dataset (50GB)]
Phillip Isola, Daniel Zoran, Dilip Krishnan, Edward H. Adelson
Learning Visual Groups From Co-occurrences in Space and Time
International Conference on Learning Representations, Workshop paper, 2016
[Paper]

2015
Daniel Zoran, Phillip Isola, Dilip Krishnan, William T. Freeman
Learning Ordinal Relationships for Mid-Level Vision
International Conference on Computer Vision (ICCV), 2015.
[Paper][Website][Code]
Phillip Isola*, Joseph J. Lim*, Isola, P.*, Edward H. Adelson
Discovering States and Transformations in Image Collections
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015 (oral).
[Paper][Website][Dataset]
Zoya Bylinskii, Phillip Isola, Constance Bainbridge, Antonio Torralba, Aude Oliva
Intrinsic and Extrinsic Effects on Image Memorability
Vision Research, 2015.
[Paper][Website][Code][Dataset]
Zhengdong Zhang, Phillip Isola, Edward H. Adelson
Sparkle Vision: Seeing the World through Random Specular Microfacets
4th IEEE International Workshop on Computational Cameras and Displays, 2015.
[Paper]

2014
Phillip Isola, Daniel Zoran, Dilip Krishnan, Edward H. Adelson
Crisp Boundary Detection Using Pointwise Mutual Information
European Conference on Computer Vision (ECCV), 2014 (oral).
[Paper][Website][Code]
Phillip Isola, Jianxiong Xiao, Devi Parikh, Antonio Torralba, Aude Oliva
What Makes a Photograph Memorable?
Pattern Analysis and Machine Intelligence (PAMI), 2013.
[Paper][Website][Dataset]

2013
Phillip Isola and Ce Liu
Scene Collaging: Analysis and Synthesis of Natural Images with Semantic Layers.
International Conference on Computer Vision (ICCV), 2013.
[Paper][Website]
Michelle Borkin, Azalea Vo, Zoya Bylinskii, Phillip Isola, Shashank Sunkavalli, Aude Oliva, Hanspeter Pfister
What Makes a Visualization Memorable?
IEEE Transactions on Visualization and Computer Graphics (Infovis), 2013.
[Paper][Website]
Wilma A. Bainbridge, Phillip Isola, Aude Oliva
The Intrinsic Memorability of Face Images.
Journal of Experimental Psychology: General, 2013.
[Paper][Website][Dataset]
Aude Oliva, Phillip Isola, Aditya Khosla, Wilma A. Bainbridge
What makes a picture memorable?
SPIE Newsroom Article, 2013.
[Article]

2012
Aditya Khosla*, Jianxiong Xiao*, Phillip Isola, Antonio Torralba, Aude Oliva
Image Memorability and Visual Inception.
SIGGRAPH Asia Technical Briefs (Invited Paper), 2012.
[Paper]
Forrester Cole, Phillip Isola, William T. Freeman, Fredo Durand, Edward H. Adelson
Shapecollage: Occlusion-aware, example-based shape interpretation.
European Conference on Computer Vision (ECCV), 2012.
[Paper][Website]
Wilma A. Bainbridge*, Phillip Isola*, Idan Blank, Aude Oliva
Establishing a database for studying human face photograph memorability.
Proceedings of the Annual Conference of the Cognitive Sciences Society, 2012.
[Paper][Website][Dataset]

2011
Phillip Isola, Devi Parikh, Antonio Torralba, Aude Oliva
Understanding the intrinsic memorability of images.
Advances in Neural Information Processing Systems (NIPS), 2011.
[Paper]Website]
Phillip Isola, Jianxiong Xiao, Antonio Torralba, Aude Oliva
What makes an image memorable?
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011.
[Paper][Website][Dataset]

2008
Nicholas B. Turk-Browne, Phillip Isola, Brian J. Scholl, Teresa A. Treat
Multidimensional visual statistical learning.
Journal of Experimental Psychology: Learning, Memory, and Cognition, 2008.
[Paper]