Senior Researcher · Microsoft

Mohsen
Fayyaz

Researcher-builder working on foundation models, post-training, multimodal learning, video understanding, and efficient model design.

Recent research

Selected papers

View all publications →
arXiv preprint·2026

STRIVE: Structured Spatiotemporal Exploration for Reinforcement Learning in Video Question Answering

Structured visual exploration for reinforcement-learning post-training of large multimodal models on video question answering.

Emad Bahrami, Olga Zatsarynna, Parth Pathak, Sunando Sengupta, Jürgen Gall, Mohsen Fayyaz
NeurIPS·2025

Enhancing Temporal Understanding in Video-LLMs through Stacked Temporal Attention in Vision Encoders

Stacked temporal attention inside the vision encoder to improve temporal understanding and reasoning in Video-LLMs.

Ali Rasekh, Erfan Bagheri Soula, Omid Daliran, Simon Gottschalk, Mohsen Fayyaz
arXiv preprint·2025

DeltaLLM: Compress LLMs with Low-Rank Deltas between Shared Weights

A post-training compression method that shares weights across Transformer blocks and models their differences with low-rank deltas.

Liana Mikaelyan, Ayyoob Imani, Mathew Salvaris, Parth Pathak, Mohsen Fayyaz
ECCV — Oral Presentation (Top 3%)·2022

Adaptive Token Sampling for Efficient Vision Transformers

Adaptive token sampling for reducing redundant computation in Vision Transformers.

Mohsen Fayyaz*, Soroush Abbasi Koohpayegani*, Farnoush Rezaei Jafari*, Sunando Sengupta, Hamid Reza Vaezi Joze, Eric Sommerlade, Hamed Pirsiavash, Jürgen Gall
View all publications →
Research impact

Google Scholar ↗

Automatically refreshable at deployment time.

Last value in source: 2026-09-14

6,823citations
23h-index
24i10-index
Professional profile

Work experience

Microsoft
Berlin, Germany
Senior Researcher · Applied Sciences Group
Jun. 2022 – Present
Microsoft
Reading, UK
Research Scientist Intern · Applied Sciences Group
Apr. 2021 – Jun. 2022
Bosch Center for Artificial Intelligence
Renningen, Germany
Research Scientist Intern
Sep. 2020 – Mar. 2021
University of Bonn
Bonn, Germany
Doctoral Researcher · Computer Vision Group
2017 – 2022
Sensifai
Remote
Computer Vision / ML Engineer
2016 – 2017
Academic background

Ph.D.

About ↓
University of Bonn
Ph.D. in Computer Science · Nov. 2017 – Apr. 2022
Summa Cum Laude — graduated with the highest distinction
Grade: 0.0 / 4.0

German grading scale: 1.0 is the highest regular grade and 4.0 is the minimum grade. A grade of 0.0 denotes the highest doctoral distinction.

Thesis: Holistic Video Understanding: Spatio-Temporal Modeling and Efficiency
Best PhD Thesis Award · Faculty of Mathematics and Natural Sciences, University of Bonn · 2025