Curriculum Vitae
Curriculum Vitae - PhD researcher in Computer Science Engineering working on multi-modal self-supervised learning and label-efficient world models for autonomous perception and control
Basics
| Name | Ciem Cornelissen |
| Label | PhD Researcher in Computer Science Engineering |
| ciem.cornelissen@ugent.be | |
| Url | https://ciemcornelissen.github.io/ |
| Summary | PhD researcher in Computer Science Engineering at IDLab (Ghent University - imec), developing self-supervised representations and label-efficient world models for autonomous perception and control. My work spans unified RGB-LiDAR-thermal representations with Le MuMo JEPA and latent action learning with LaFreeWM, which infers discrete latent actions from unlabelled observation sequences before limited-label grounding for raw-action planning. |
Work
-
2024.06 - Present PhD Researcher
IDLab, Ghent University - imec
Research on self-supervised representation learning and label-efficient latent world models for autonomous perception and control, spanning multi-modal sensor fusion, action-label-free pretraining, and raw-action planning.
- Developed LaFreeWM, a label-efficient JEPA world model that infers discrete latent actions during action-label-free pretraining and uses 1% or 10% labelled trajectories for raw-action planning
- Identified a prediction-planning mismatch: removing quantization reduced held-out prediction MSE by about 60-fold but lowered long-horizon planning success from 60.7% to 18.0%
- Developed Le MuMo JEPA, a multi-modal self-supervised framework for unified RGB-LiDAR-thermal representations, accepted at the CVPR 2026 URVIS Workshop
- Designed learnable fusion tokens as an efficient latent bottleneck and evaluated frozen representations on Waymo, nuScenes, and FLIR for depth, segmentation, and 3D detection
- Developed LISA for illumination-invariant hyperspectral learning and OHSLIC for efficient UAV-based phenotype segmentation
- Research includes the LaFreeWM preprint and publications in CVPR Workshops, IEEE Internet of Things Journal, WACV Workshops, and Neural Computing and Applications
Education
-
2023.09 - Present Ghent, Belgium
PhD
Ghent University - imec
Computer Science Engineering
- Multi-Modal Self-Supervised Learning
- Predictive Representation Learning
- Latent World Models
- Autonomous Perception
-
2022.09 - 2023.06 Leuven, Belgium
Advanced Master
KU Leuven
Artificial Intelligence
- Deep Learning
- Computer Vision
- Data Science
- Machine Learning
-
2020.09 - 2022.06 Ghent, Belgium
Master of Science
Ghent University
Physics
- Complex Systems
- Statistical Mechanics
- Artificial Intelligence Electives
-
2017.09 - 2020.06 Ghent, Belgium
Publications
-
2026.09.01 LaFree World Model: Label-Free Pretraining for Action-Conditioned JEPA World Models
Preprint
A label-efficient JEPA world model that learns discrete latent actions from unlabelled observation sequences, then grounds its predictor with limited labelled data for raw-action planning. The study also exposes a prediction-planning mismatch in which lower prediction error does not necessarily produce better control.
-
2026.03.26 Le MuMo JEPA: Multi-Modal Self-Supervised Representation Learning with Learnable Fusion Tokens
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops - URVIS
A self-supervised framework that learns unified representations from RGB images and aligned companion modalities. Extends LeJEPA to the multi-modal setting by learning fusion tokens that act as a latent bottleneck between modality-specific patch stems inside a shared transformer.
-
2025.10.03 In-Field Mapping of Grape Yield and Quality with Illumination-Invariant Deep Learning
IEEE Internet of Things Journal
Development of the LISA framework for illumination-invariant hyperspectral imaging analysis in precision viticulture. An end-to-end IoT-enabled robotic system for non-destructive, real-time mapping of grape yield and quality.
-
2025.06.30 Computational Fairness in Adaptive Neural Networks
Neural Computing and Applications
A novel investigation into the fairness of adaptive neural networks, analyzing disparities in computational resource allocation across demographic subgroups. Introduces computational resource allocation as a new dimension of AI fairness.
-
2025.03.01 Adaptive Clustering for Efficient Phenotype Segmentation of UAV Hyperspectral Data
IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Workshops
Introduction of the OHSLIC algorithm for computationally efficient, real-time phenotype segmentation from hyperspectral imaging data. Enables on-device processing on UAVs.
Skills
| Machine Learning & AI | |
| Self-Supervised Learning | |
| Predictive Representation Learning | |
| Latent World Models | |
| Latent Action Learning | |
| Joint-Embedding Predictive Architectures (JEPA) | |
| Multi-Modal Representation Learning | |
| Transformer Architectures | |
| PyTorch | |
| TensorFlow |
| Sensors & Data Processing | |
| RGB, LiDAR, and Thermal Sensors | |
| Multi-modal Sensor Fusion | |
| Autonomous Perception | |
| Depth Estimation | |
| Semantic Segmentation | |
| 3D Object Detection | |
| Hyperspectral Imaging (HSI) | |
| On-Device Inference |
| Software Development | |
| Python | |
| C/C++ | |
| Git | |
| Docker | |
| Linux | |
| LaTeX |
Languages
| Dutch | |
| Native speaker |
| English | |
| Fluent (C2) |
Interests
| World Models & Representation Learning | |
| Latent World Models | |
| Predictive Representations | |
| JEPA | |
| Latent Action Learning | |
| Self-Supervised Learning |
| Autonomous & Embodied AI | |
| Multi-Modal Perception | |
| Physical AI | |
| Robotics | |
| Prediction and Planning | |
| Sensor Fusion |
| Efficient & Robust Learning | |
| Efficient Architectures | |
| Label-Efficient Learning | |
| Domain Generalization | |
| On-Device Inference | |
| Robustness |