Bryan Russell

Bryan Russell

Senior Research Scientist
Adobe Research

Address:
601 Townsend Street
San Francisco, CA 94103

E-mail: brussell at adobe.com

Internship advice: I'm happy to collaborate with enthusiastic and talented Ph.D., master's, and advanced undergraduate students in computer science. I typically hire interns to work with me in San Francisco during the summer, but may have availability at other times throughout the year. For summer internships I review applications between November and February. Intern slots are limited and competitive. To apply, e-mail me your CV, 1-2 references, and a brief description of what you would like to work on during your internship.

Research: My research is in computer vision, machine learning, and computer graphics. I'm interested in the following areas:

Learning from video: How can we learn a good representation of video via (cross-modal) self supervision? How can we best jointly model natural language, audio, and video? Potential applications include large-scale search and retrieval for video and smart video editing.
3D scene understanding: How can we recover a good (editable and controllable) representation of a depicted 3D scene from one or more images? How can we learn real-world physics from video? How can we learn from real-world interactions in an environment? Potential applications include augmented reality, 2D-3D compositing and editing, and robotics.

Bio: I received my Ph.D. from MIT in the Computer Science and Artificial Intelligence Laboratory under the supervision of Professors Bill Freeman and Antonio Torralba. I was a post-doctoral fellow in the INRIA Willow team at the Département d'Informatique of Ecole Normale Supérieure. Before joining Adobe, I was a Research Scientist with Intel Labs as part of the Intel Science and Technology Center for Visual Computing (ISTC-VC) and Affiliate Faculty at the University of Washington.

Professional activities:

Area chair: CVPR 2016, 3DV 2016, ECCV 2018, CVPR 2019, CVPR 2020, ECCV 2020, CVPR 2023, NeurIPS 2023.
DEI chair: ECCV 2022.

Commercial highlights

Video shot size and angle filter in Adobe Stock (with Markus Woodson, Josef Sivic, Joon-Young Lee, Hailin Jin, Fabian Caba, Ruppesh Nalwaya, Markus Woodson). Adobe MAX 2021 announcement.
Video smart tags in Adobe Experience Manager (with Josef Sivic, Joon-Young Lee, Hailin Jin, Fabian Caba, Ruppesh Nalwaya, Markus Woodson). Feature description and release notes.
Video auto-tagging in Adobe Experience Manager UGC (with Josef Sivic, Joon-Young Lee, Hailin Jin, Ruppesh Nalwaya, Markus Woodson). Blog post on our work.
Auto-ground plane in Adobe Dimension (with Geoff Oxholm, J Eisenmann, Emiliano Gambaretto, and Eli Shechtman). Blog post on our work.
Automatic portrait segmentatation in Adobe Photoshop Mix mobile app's "auto cut out" feature (with Francisco Massa, Ian Sachs, and Shoaib Kamil). Selfie demo video that includes our feature, along with other selfie features.

Publications

Selected projects

	Language-Guided Music Recommendation for Video via Prompt Analogies Daniel McKee, Justin Salamon, Josef Sivic, Bryan Russell Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
	Conditional Generation of Audio from Video via Foley Analogies Yuexi Du, Ziyang Chen, Justin Salamon, Bryan Russell, Andrew Owens Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
	Language-Guided Audio-Visual Source Separation via Trimodal Consistency Reuben Tan, Arijit Ray, Andrea Burns, Bryan A. Plummer, Justin Salamon, Oriol Nieto, Bryan Russell, Kate Saenko Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
	Meta-Personalizing Vision-Language Models to Find Named Instances in Video Chun-Hsiao Yeh, Bryan Russell, Josef Sivic, Fabian Caba Heilbron, Simon Jenni Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
	Monocular Dynamic View Synthesis: A Reality Check Hang Gao, Ruilong Li, Shubham Tulsiani, Bryan Russell, Angjoo Kanazawa Advances in Neural Information Processing Systems (NeurIPS), 2022.
	It's Time for Artistic Correspondence in Music and Video Dídac Surís, Carl Vondrick, Bryan Russell, Justin Salamon Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
	Neural Volumetric Object Selection Zhongzheng Ren, Aseem Agarwala, Bryan Russell, Alexander G. Schwing, Oliver Wang Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
	Focal Length and Object Pose Estimation via Render and Compare Georgy Ponimatkin, Yann Labbé, Bryan Russell, Mathieu Aubry, Josef Sivic Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
	Look at What I'm Doing: Self-Supervised Spatial Grounding of Narrations in Instructional Videos Reuben Tan, Bryan A. Plummer, Kate Saenko, Hailin Jin, Bryan Russell Advances in Neural Information Processing Systems (NeurIPS), 2021.
	Weakly Supervised Human-Object Interaction Detection in Video via Contrastive Spatiotemporal Regions Shuang Li, Yilun Du, Antonio Torralba, Josef Sivic, Bryan Russell International Conference on Computer Vision (ICCV), 2021.
	Editing Conditional Radiance Fields Steven Liu, Xiuming Zhang, Zhoutong Zhang, Richard Zhang, Jun-Yan Zhu, Bryan Russell International Conference on Computer Vision (ICCV), 2021.
	Contact and Human Dynamics from Monocular Video Davis Rempe, Leonidas J. Guibas, Aaron Hertzmann, Bryan Russell, Ruben Villegas, Jimei Yang European Conference on Computer Vision (ECCV), 2020.
	Telling Left from Right: Learning Spatial Correspondence of Sight and Sound Karren Yang, Bryan Russell, Justin Salamon Conference on Computer Vision and Pattern Recognition (CVPR), 2020. Adobe blog
	Learning Elementary Structures for 3D Shape Generation and Matching Theo Deprelle, Thibault Groueix, Matthew Fisher, Vladimir G. Kim, Bryan Russell, Mathieu Aubry Advances in Neural Information Processing Systems (NeurIPS), 2019.
	Neural Re-Simulation for Generating Bounces in Single Images Carlo Innamorati, Bryan Russell, Danny M. Kaufman, Niloy J. Mitra International Conference on Computer Vision (ICCV), 2019.
	FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images Christian Zimmermann, Duygu Ceylan, Jimei Yang, Bryan Russell, Max Argus, Thomas Brox International Conference on Computer Vision (ICCV), 2019.
	Unsupervised Cycle-Consistent Deformation for Shape Matching Thibault Groueix, Matthew Fisher, Vladimir G. Kim, Bryan Russell, Mathieu Aubry Symposium on Geometry Processing (SGP), 2019.
	Bounce and Learn: Modeling Scene Dynamics with Real-World Bounces Senthil Purushwalkam, Abhinav Gupta, Danny Kaufman, Bryan Russell International Conference on Learning Representations (ICLR), 2019. Adobe blog
	Photometric Mesh Optimization for Video-Aligned 3D Object Reconstruction Chen-Hsuan Lin, Oliver Wang, Bryan Russell, Eli Shechtman, Vladimir G. Kim, Matthew Fisher, Simon Lucey Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
	B-Script: Transcript-based B-roll Video Editing with Recommendations Bernd Huber, Hijung Valentina Shin, Bryan Russell, Oliver Wang, Gautham J. Mysore ACM Conference on Human Factors in Computing Systems (CHI), 2019. Adobe blog
	Localizing Moments in Video with Temporal Language Lisa Anne Hendricks, Oliver Wang, Eli Shechtman, Josef Sivic, Trevor Darrell, Bryan Russell Conference on Empirical Methods in Natural Language Processing (EMNLP), 2018.
	BodyNet: Volumetric Inference of 3D Human Body Shapes Gül Varol, Duygu Ceylan, Bryan Russell, Jimei Yang, Ersin Yumer, Ivan Laptev, Cordelia Schmid European Conference on Computer Vision (ECCV), 2018.
	3D-CODED: 3D Correspondences by Deep Deformation Thibault Groueix, Matthew Fisher, Vladimir G. Kim, Bryan Russell, Mathieu Aubry European Conference on Computer Vision (ECCV), 2018.
	AtlasNet: A Papier-Mâché Approach to Learning 3D Surface Generation Thibault Groueix, Matthew Fisher, Vladimir G. Kim, Bryan Russell, Mathieu Aubry Conference on Computer Vision and Pattern Recognition (CVPR), 2018. Adobe blog
	Transferring Image-Based Edits for Multi-Channel Compositing James W. Hennessey, Wilmot Li, Bryan Russell, Eli Shechtman, Niloy J. Mitra ACM Transactions on Graphics (SIGGRAPH Asia), 2017.
	Localizing Moments in Video with Natural Language Lisa Anne Hendricks, Oliver Wang, Eli Shechtman, Josef Sivic, Trevor Darrell, Bryan Russell International Conference on Computer Vision (ICCV), 2017. Adobe blog
	Learning Visual Importance for Graphic Designs and Data Visualizations Zoya Bylinskii, Nam Wook Kim, Peter O'Donovan, Sami Alsheikh, Spandan Madan, Hanspeter Pfister, Fredo Durand, Bryan Russell, Aaron Hertzmann UIST, 2017. Best paper honorable mention
	ActionVLAD: Learning Spatio-temporal Aggregation for Action Classification Rohit Girdhar, Deva Ramanan, Abhinav Gupta, Josef Sivic, Bryan Russell Conference on Computer Vision and Pattern Recognition (CVPR), 2017.
	PixelNet: Representation of the Pixels, by the Pixels, and for the Pixels Aayush Bansal, Xinlei Chen, Bryan Russell, Abhinav Gupta, Deva Ramanan arXiv, 2017.
	Marr Revisited: 2D-3D Alignment via Surface Normal Prediction Aayush Bansal, Bryan C. Russell, Abhinav Gupta Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
	Deep Exemplar 2D-3D Detection by Adapting from Real to Rendered Views Francisco Massa, Bryan C. Russell, Mathieu Aubry Conference on Computer Vision and Pattern Recognition (CVPR), 2016.
	Understanding Deep Features with Computer-Generated Imagery Mathieu Aubry and Bryan C. Russell IEEE International Conference on Computer Vision (ICCV), 2015.
	Deep Classifiers from Image Tags in the Wild Hamid Izadinia, Bryan C. Russell, Ali Farhadi, Matthew D. Hoffman, Aaron Hertzmann Multimedia COMMONS, ACM Multimedia, 2015.
	The 3D Jigsaw Puzzle: Mapping Large Indoor Spaces Ricardo Martin-Brualla, Yanling He, Bryan C. Russell, Steven M. Seitz European Conference on Computer Vision (ECCV), 2014.
	Seeing 3D Chairs: Exemplar Part-based 2D-3D Alignment Using a Large Dataset of CAD Models Mathieu Aubry, Daniel Maturana, Alexei A. Efros, Bryan C. Russell, Josef Sivic IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
	Painting-to-3D Model Alignment Via Discriminative Visual Elements Mathieu Aubry, Bryan C. Russell, Josef Sivic ACM Transactions on Graphics (presented at SIGGRAPH 2014), Vol. 33, No. 2, 2014.
	3D Wikipedia: Using Online Text to Automatically Label and Navigate Reconstructed Geometry Bryan C. Russell, Ricardo Martin-Brualla, Daniel J. Butler, Steven M. Seitz, Luke Zettlemoyer ACM Transactions on Graphics (SIGGRAPH Asia), Vol. 32, No. 6, 2013.
	Localizing 3D Cuboids in Single-view Images Jianxiong Xiao, Bryan C. Russell, Antonio Torralba Advances in Neural Information Processing Systems (NIPS), 2012.
	Automatic Alignment of Paintings and Photographs Depicting a 3D Scene Bryan C. Russell, Josef Sivic, Jean Ponce, Hélène Dessales 3rd International IEEE Workshop on 3D Representation for Recognition (3dRR-11), associated with ICCV 2011.
	Segmenting Scenes by Matching Image Composites Bryan C. Russell, Alexei A. Efros, Josef Sivic, William T. Freeman, Andrew Zisserman Advances in Neural Information Processing Systems (NIPS), 2009.
	LabelMe video: Building a Video Database with Human Annotations Jenny Yuen, Bryan C. Russell, Ce Liu, Antonio Torralba IEEE International Conference on Computer Vision (ICCV), 2009.
	LabelMe3D: Building a Database of 3D Scenes from User Annotations Bryan C. Russell and Antonio Torralba IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009.
	LabelMe: A Database and Web-based Tool for Image Annotation Bryan C. Russell, Antonio Torralba, Kevin P. Murphy, William T. Freeman International Journal of Computer Vision, 77(1-3):157-173, 2008.
	Object Recognition by Scene Alignment Bryan C. Russell, Antonio Torralba, Ce Liu, Rob Fergus, William T. Freeman Advances in Neural Information Processing Systems (NIPS), 2007.
	Using Multiple Segmentations to Discover Objects and their Extent in Image Collections Bryan C. Russell, Alexei A. Efros, Josef Sivic, William T. Freeman, Andrew Zisserman IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2006.
	Discovering Objects and their Location in Images Josef Sivic, Bryan C. Russell, Alexei A. Efros, Andrew Zisserman, William T. Freeman International Conference on Computer Vision (ICCV), 2005. Winner of the Helmholtz "test-of-time" Prize at ICCV 2017

Misc.

CVPR 2013: Intel-sponsored panel discussion on computational bottlenecks in computer vision
Spring 2012: CSE 590V: Computer vision seminar
Fall 2011: CSE 590V: Computer vision seminar