Sebastian Koch

Hi! I am a final-year PhD student in computer science at the University of Ulm, advised by Timo Ropinski. During my PhD, I closely collaborate with Johanna Wald and Federico Tombari at Google, and I was funded by and collaborated with the Bosch Center for AI during the first three years of my PhD.

My research lies at the intersection of 3D scene understanding and embodied AI. I focus on developing scene representations that go beyond object-centric models by capturing object semantics, interactions, and relationships, with applications in robotics and AR/VR.

I received my master's degree in computer science from the University of Tübingen, where I worked on multi-view and symmetry-aware 6D pose estimation under the supervision of Andreas Geiger and Gerhard Neumann, in collaboration with BCAI. Previously, I earned my bachelor's degree in computer science from DHBW Stuttgart and gained industry experience through multiple internships at Bosch in robotics and autonomous driving perception.

Email  |  CV  |  GitHub  |  Google Scholar  |  LinkedIn  |  Twitter

Portrait of Sebastian Koch

Sebastian Koch

Hi! I am a final-year PhD student in computer science at the University of Ulm, advised by Timo Ropinski. During my PhD, I closely collaborate with Johanna Wald and Federico Tombari at Google, and I was funded by and collaborated with the Bosch Center for AI during the first three years of my PhD.

My research lies at the intersection of 3D scene understanding and embodied AI. I focus on developing scene representations that go beyond object-centric models by capturing object semantics, interactions, and relationships, with applications in robotics and AR/VR.

I received my master's degree in computer science from the University of Tübingen, where I worked on multi-view and symmetry-aware 6D pose estimation under the supervision of Andreas Geiger and Gerhard Neumann, in collaboration with BCAI. Previously, I earned my bachelor's degree in computer science from DHBW Stuttgart and gained industry experience through multiple internships at Bosch in robotics and autonomous driving perception.

Email  |  CV  |  GitHub  |  Google Scholar  |  LinkedIn  |  Twitter

Uni Ulm logo Google logo Bosch logo Uni Tübingen logo
News
  • 05/2025 I was named an Oustanding Reviewer at CVPR 2025. Super proud about this!
  • 05/2025 I left Bosch Center for AI and joined Google Munich as a Student Researcher for the next 6 months!
  • 02/2025 My paper RelationField got accepted at CVPR 2025!
  • 02/2025 I gave a talk on Language-driven 3D Scene Graph prediction at the Huawei Munich Research Center (Slides).
  • 04/2024 I was accepted at the prestigious International Computer Vision Summer School ICVSS 2024.
  • 02/2024 My paper Open3DSG got accepted at CVPR 2024! I will also present it at the OpenSUN & SG2RL workshop.
  • 10/2023 My paper SGRec3D got accepted at WACV 2024!
  • 10/2023 My paper Lang3DSG got accepted at 3DV 2024!
  • ---- show more ----
Research
Unified Semantic Transformer for 3D Scene Understanding
Sebastian Koch, Johanna Wald, Hidenobu Matsuki, Pedro Hermosilla,
Timo Ropinski, Federico Tombari
paper | project page | bibtex

A single feed-forward model that unifies multiple 3D semantic tasks from RGB input.

OpenHype: Hyperbolic Embeddings for Hierarchical Open-Vocabulary Radiance Fields
Lisa Weijler, Sebastian Koch, Fabio Poiesi, Timo Ropinski, Pedro Hermosilla
Advances in Neural Information Processing Systems (NeurIPS) , 2025
paper | project page | bibtex

Radiance fields with hyperbolic open-vocabulary features enabling reasoning over object hierarchies.

RelationField: Relate Anything in Radiance Fields
Sebastian Koch, Johanna Wald, Mirco Colosi, Narunas Vaskevicius, Pedro Hermosilla, Federico Tombari, Timo Ropinski
IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2025
paper | project page | code | bibtex

Open-Vocabulary 3D Relationships in Radiance Fields, learned solely from 2D image supervision.

DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Models
Yuchen Liu, Luigi Palmieri, Sebastian Koch, Ilche Georgievski, Marco Aiello
IEEE International Conference on Robotics & Automation (ICRA) , 2025
paper | project page | bibtex

Long-term robot task planning with 3D Scene Graphs and LLMs.

Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds
with Queryable Objects and Open-Set Relationships

Sebastian Koch, Narunas Vaskevicius, Mirco Colosi, Pedro Hermosilla, Timo Ropinski
IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2024
paper | project page | poster | code | video | bibtex

The first open-vocabulary 3D scene graph method with open-world relationships.

Lang3DSG: Language-based contrastive pre-training for 3D Scene Graph prediction
Sebastian Koch, Pedro Hermosilla, Narunas Vaskevicius, Mirco Colosi, Timo Ropinski
International Conference on 3D Vision (3DV), 2024
paper | project page | poster | bibtex

Language and 3D scene graph alignment using contrastive pre-training.

SGRec3D: Self-Supervised 3D Scene Graph Learning via Object-Level Scene Reconstruction
Sebastian Koch, Pedro Hermosilla, Narunas Vaskevicius, Mirco Colosi, Timo Ropinski
IEEE Winter Conference on Applications of Computer Vision (WACV), 2024
paper | project page | poster | video | bibtex

A label-efficient method to predict 3D semantic scene graphs for indoor environments.

SyMFM6D: Symmetry-aware Multi-directional Fusion for Multi-View 6D Object Pose Estimation
Fabian Duffhauß, Sebastian Koch, Hanna Ziesche, Ngo Anh Vien, Gerhard Neumann
IEEE Robotics and Automation Letter (RA-L), 2023 & International Conference on Robotics and Automation (ICRA) 2024
paper | code | bibtex

A 6D pose estimation approach utilizing multiple viewpoints and considering object symmetries.

Multi-View RGB-D Fusion for 6D Pose Estimation
Sebastian Koch,
M.Sc. Thesis, University of Tübingen, 2022
thesis | slides | bibtex

Comprehensive Analysis of the Object Detection Pipeline on UAVs
Leon Amadeus Varga, Sebastian Koch, Andreas Zell,
Remote Sensing, 2022
paper | code | bibtex