Moritz Böhle (PhD Student)

MSc Moritz Daniel Böhle

Address: Max-Planck-Institut für Informatik
Saarland Informatics Campus
Campus E1 4
66123 Saarbrücken
Standort: E1 4 - 622
Telefon: +49 681 9325 2000
Fax: +49 681 9325 2099
E-mail: Get email via email

Personal Information

Publications

2024

Article

S. Rao, M. Boehle, and B. Schiele

“Better Understanding Differences in Attribution Methods via Systematic Evaluations,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 46, no. 6, 2024.

mehr

BibTeX

@article{RaoTPAMI24,
TITLE = {Better Understanding Differences in Attribution Methods via Systematic Evaluations},
AUTHOR = {Rao, Sukrut and Boehle, Moritz and Schiele, Bernt},
LANGUAGE = {eng},
DOI = {10.1109/TPAMI.2024.3353528},
PUBLISHER = {IEEE},
ADDRESS = {Piscataway, NJ},
YEAR = {2024},
DATE = {2024},
JOURNAL = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
VOLUME = {46},
NUMBER = {6},
PAGES = {4090--4101},
}

Endnote

%0 Journal Article
%A Rao, Sukrut
%A Boehle, Moritz
%A Schiele, Bernt
%+ Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
%T Better Understanding Differences in Attribution Methods via Systematic Evaluations : 
%G eng
%U http://hdl.handle.net/21.11116/0000-000F-5532-9
%R 10.1109/TPAMI.2024.3353528
%7 2024
%D 2024
%J IEEE Transactions on Pattern Analysis and Machine Intelligence
%V 46
%N 6
%& 4090
%P 4090 - 4101
%I IEEE
%C Piscataway, NJ

Thesis

D2IMPR-CS

M. Böhle

“Towards Designing Inherently Interpretable Deep Neural Networks for Image Classification,” Universität des Saarlandes, Saarbrücken, 2024.

mehr

BibTeX

@phdthesis{BoehlePhD24,
TITLE = {Towards Designing Inherently Interpretable Deep Neural Networks for Image Classification},
AUTHOR = {B{\"o}hle, Moritz},
LANGUAGE = {eng},
URL = {urn:nbn:de:bsz:291--ds-421904},
DOI = {10.22028/D291-42190},
SCHOOL = {Universit{\"a}t des Saarlandes},
ADDRESS = {Saarbr{\"u}cken},
YEAR = {2024},
DATE = {2024},
}

Endnote

%0 Thesis
%A B&#246;hle, Moritz
%Y Schiele, Bernt
%Y Fritz, Mario
%A referee: Akata, Zeynep
%A referee: Brendel, Wieland
%+ Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
International Max Planck Research School, MPI for Informatics, Max Planck Society
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
External Organizations
External Organizations
External Organizations
%T Towards Designing Inherently Interpretable Deep Neural Networks for Image Classification : 
%G eng
%U http://hdl.handle.net/21.11116/0000-000F-76AA-D
%U urn:nbn:de:bsz:291--ds-421904
%R 10.22028/D291-42190
%F OTHER: hdl:20.500.11880/37907
%I Universit&#228;t des Saarlandes
%C Saarbr&#252;cken
%D 2024
%P XIII, 265 p.
%V phd
%9 phd
%U https://publikationen.sulb.uni-saarland.de/handle/20.500.11880/37907

Paper

A. Parchami-Araghi, M. D. Boehle, S. S. Rao, and B. Schiele

“Good Teachers Explain: Explanation-Enhanced Knowledge Distillation,” 2024. [Online]. Available: https://arxiv.org/abs/2402.03119.

mehr

Abstract

Knowledge Distillation (KD) has proven effective for compressing large
teacher models into smaller student models. While it is well known that student
models can achieve similar accuracies as the teachers, it has also been shown
that they nonetheless often do not learn the same function. It is, however,
often highly desirable that the student's and teacher's functions share similar
properties such as basing the prediction on the same input features, as this
ensures that students learn the 'right features' from the teachers. In this
work, we explore whether this can be achieved by not only optimizing the
classic KD loss but also the similarity of the explanations generated by the
teacher and the student. Despite the idea being simple and intuitive, we find
that our proposed 'explanation-enhanced' KD (e$^2$KD) (1) consistently provides
large gains in terms of accuracy and student-teacher agreement, (2) ensures
that the student learns from the teacher to be right for the right reasons and
to give similar explanations, and (3) is robust with respect to the model
architectures, the amount of training data, and even works with 'approximate',
pre-computed explanations.

BibTeX

@online{ParchamiAraghi2402.03119,
TITLE = {Good Teachers Explain: Explanation-Enhanced Knowledge Distillation},
AUTHOR = {Parchami-Araghi, Amin and Boehle, Moritz Daniel and Rao, Sukrut Sridhar and Schiele, Bernt},
LANGUAGE = {eng},
URL = {https://arxiv.org/abs/2402.03119},
EPRINT = {2402.03119},
EPRINTTYPE = {arXiv},
YEAR = {2024},
ABSTRACT = {Knowledge Distillation (KD) has proven effective for compressing large<br>teacher models into smaller student models. While it is well known that student<br>models can achieve similar accuracies as the teachers, it has also been shown<br>that they nonetheless often do not learn the same function. It is, however,<br>often highly desirable that the student's and teacher's functions share similar<br>properties such as basing the prediction on the same input features, as this<br>ensures that students learn the 'right features' from the teachers. In this<br>work, we explore whether this can be achieved by not only optimizing the<br>classic KD loss but also the similarity of the explanations generated by the<br>teacher and the student. Despite the idea being simple and intuitive, we find<br>that our proposed 'explanation-enhanced' KD (e$^2$KD) (1) consistently provides<br>large gains in terms of accuracy and student-teacher agreement, (2) ensures<br>that the student learns from the teacher to be right for the right reasons and<br>to give similar explanations, and (3) is robust with respect to the model<br>architectures, the amount of training data, and even works with 'approximate',<br>pre-computed explanations.<br>},
}

Endnote

%0 Report
%A Parchami-Araghi, Amin
%A Boehle, Moritz Daniel
%A Rao, Sukrut Sridhar
%A Schiele, Bernt
%+ Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
%T Good Teachers Explain: Explanation-Enhanced Knowledge Distillation : 
%G eng
%U http://hdl.handle.net/21.11116/0000-000F-5534-7
%U https://arxiv.org/abs/2402.03119
%D 2024
%X   Knowledge Distillation (KD) has proven effective for compressing large<br>teacher models into smaller student models. While it is well known that student<br>models can achieve similar accuracies as the teachers, it has also been shown<br>that they nonetheless often do not learn the same function. It is, however,<br>often highly desirable that the student's and teacher's functions share similar<br>properties such as basing the prediction on the same input features, as this<br>ensures that students learn the 'right features' from the teachers. In this<br>work, we explore whether this can be achieved by not only optimizing the<br>classic KD loss but also the similarity of the explanations generated by the<br>teacher and the student. Despite the idea being simple and intuitive, we find<br>that our proposed 'explanation-enhanced' KD (e$^2$KD) (1) consistently provides<br>large gains in terms of accuracy and student-teacher agreement, (2) ensures<br>that the student learns from the teacher to be right for the right reasons and<br>to give similar explanations, and (3) is robust with respect to the model<br>architectures, the amount of training data, and even works with 'approximate',<br>pre-computed explanations.<br>
%K Computer Science, Computer Vision and Pattern Recognition, cs.CV,Computer Science, Artificial Intelligence, cs.AI,Computer Science, Learning, cs.LG

2023

Conference paper

S. Rao, M. Böhle, A. Parchami-Araghi, and B. Schiele

“Studying How to Efficiently and Effectively Guide Models with Explanations,” in IEEE/CVF International Conference on Computer Vision (ICCV 2023), Paris, France, 2023.

mehr

BibTeX

@inproceedings{Rao_ICCV23,
TITLE = {Studying How to Efficiently and Effectively Guide Models with Explanations},
AUTHOR = {Rao, Sukrut and B{\"o}hle, Moritz and Parchami-Araghi, Amin and Schiele, Bernt},
LANGUAGE = {eng},
ISBN = {979-8-3503-0718-4},
DOI = {10.1109/ICCV51070.2023.00184},
PUBLISHER = {IEEE},
YEAR = {2023},
MARGINALMARK = {$\bullet$},
DATE = {2023},
BOOKTITLE = {IEEE/CVF International Conference on Computer Vision (ICCV 2023)},
PAGES = {1922--1933},
ADDRESS = {Paris, France},
}

Endnote

%0 Conference Proceedings
%A Rao, Sukrut
%A B&#246;hle, Moritz
%A Parchami-Araghi, Amin
%A Schiele, Bernt
%+ Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
%T Studying How to Efficiently and Effectively Guide Models with Explanations : 
%G eng
%U http://hdl.handle.net/21.11116/0000-000D-CA7B-6
%R 10.1109/ICCV51070.2023.00184
%D 2023
%B IEEE/CVF International Conference on Computer Vision
%Z date of event: 2023-10-02 - 2023-10-06
%C Paris, France
%B IEEE/CVF International Conference on Computer Vision
%P 1922 - 1933
%I IEEE
%@ 979-8-3503-0718-4

2022

Conference paper

M. Böhle, M. Fritz, and B. Schiele

“B-cos Networks: Alignment is All We Need for Interpretability,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), New Orleans, LA, USA, 2022.

mehr

BibTeX

@inproceedings{Boehle_CVPR2022,
TITLE = {B-cos Networks: {A}lignment is All We Need for Interpretability},
AUTHOR = {B{\"o}hle, Moritz and Fritz, Mario and Schiele, Bernt},
LANGUAGE = {eng},
ISBN = {978-1-6654-6946-3},
DOI = {10.1109/CVPR52688.2022.01008},
PUBLISHER = {IEEE},
YEAR = {2022},
MARGINALMARK = {$\bullet$},
BOOKTITLE = {IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022)},
PAGES = {10319--10328},
ADDRESS = {New Orleans, LA, USA},
}

Endnote

%0 Conference Proceedings
%A B&#246;hle, Moritz
%A Fritz, Mario
%A Schiele, Bernt
%+ Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
External Organizations
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
%T B-cos Networks: Alignment is All We Need for Interpretability : 
%G eng
%U http://hdl.handle.net/21.11116/0000-000A-6F96-1
%R 10.1109/CVPR52688.2022.01008
%D 2022
%B 35th IEEE/CVF Conference on Computer Vision and Pattern Recognition
%Z date of event: 2022-06-19 - 2022-06-24
%C New Orleans, LA, USA
%B IEEE/CVF Conference on Computer Vision and Pattern Recognition
%P 10319 - 10328
%I IEEE
%@ 978-1-6654-6946-3

Conference paper

D4D2

S. Rao, M. Böhle, and B. Schiele

“Towards Better Understanding Attribution Methods,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), New Orleans, LA, USA, 2022.

mehr

BibTeX

@inproceedings{Rao_CVPR2022,
TITLE = {Towards Better Understanding Attribution Methods},
AUTHOR = {Rao, Sukrut and B{\"o}hle, Moritz and Schiele, Bernt},
LANGUAGE = {eng},
ISBN = {978-1-6654-6946-3},
DOI = {10.1109/CVPR52688.2022.00998},
PUBLISHER = {IEEE},
YEAR = {2022},
MARGINALMARK = {$\bullet$},
BOOKTITLE = {IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022)},
PAGES = {10213--10222},
ADDRESS = {New Orleans, LA, USA},
}

Endnote

%0 Conference Proceedings
%A Rao, Sukrut
%A B&#246;hle, Moritz
%A Schiele, Bernt
%+ Computer Graphics, MPI for Informatics, Max Planck Society
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
%T Towards Better Understanding Attribution Methods : 
%G eng
%U http://hdl.handle.net/21.11116/0000-000A-6F91-6
%R 10.1109/CVPR52688.2022.00998
%D 2022
%B 35th IEEE/CVF Conference on Computer Vision and Pattern Recognition
%Z date of event: 2022-06-19 - 2022-06-24
%C New Orleans, LA, USA
%B IEEE/CVF Conference on Computer Vision and Pattern Recognition
%P 10213 - 10222
%I IEEE
%@ 978-1-6654-6946-3

Article

M. D. Böhle, M. Fritz, and B. Schiele

“Optimising for Interpretability: Convolutional Dynamic Alignment Networks,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 6, 2022.

mehr

BibTeX

@article{Boehle2109.13004,
TITLE = {Optimising for Interpretability: Convolutional Dynamic Alignment Networks},
AUTHOR = {B{\"o}hle, Moritz Daniel and Fritz, Mario and Schiele, Bernt},
LANGUAGE = {eng},
ISSN = {0162-8828},
DOI = {10.1109/TPAMI.2022.3226041},
PUBLISHER = {IEEE},
ADDRESS = {Piscataway, NJ},
YEAR = {2022},
MARGINALMARK = {$\bullet$},
JOURNAL = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
VOLUME = {45},
NUMBER = {6},
PAGES = {7625--7638},
}

Endnote

%0 Journal Article
%A B&#246;hle, Moritz Daniel
%A Fritz, Mario
%A Schiele, Bernt
%+ Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
External Organizations
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
%T Optimising for Interpretability: Convolutional Dynamic Alignment
  Networks : 
%G eng
%U http://hdl.handle.net/21.11116/0000-0009-8113-F
%R 10.1109/TPAMI.2022.3226041
%7 2022
%D 2022
%J IEEE Transactions on Pattern Analysis and Machine Intelligence
%O IEEE Trans. Pattern Anal. Mach. Intell.
%V 45
%N 6
%& 7625
%P 7625 - 7638
%I IEEE
%C Piscataway, NJ
%@ false

2021

Conference paper

M. D. Böhle, M. Fritz, and B. Schiele

“Convolutional Dynamic Alignment Networks for Interpretable Classifications,” in IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), Nashville, TN, USA (Virtual), 2021.

mehr

BibTeX

@inproceedings{Boehle_CVPR21,
TITLE = {Convolutional Dynamic Alignment Networks for Interpretable Classifications},
AUTHOR = {B{\"o}hle, Moritz Daniel and Fritz, Mario and Schiele, Bernt},
LANGUAGE = {eng},
ISBN = {978-1-6654-4509-2},
DOI = {10.1109/CVPR46437.2021.00990},
PUBLISHER = {IEEE},
YEAR = {2021},
MARGINALMARK = {$\bullet$},
BOOKTITLE = {IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021)},
PAGES = {10029--10038},
ADDRESS = {Nashville, TN, USA (Virtual)},
}

Endnote

%0 Conference Proceedings
%A B&#246;hle, Moritz Daniel
%A Fritz, Mario
%A Schiele, Bernt
%+ Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
External Organizations
Computer Vision and Machine Learning, MPI for Informatics, Max Planck Society
%T Convolutional Dynamic Alignment Networks for Interpretable Classifications : 
%G eng
%U http://hdl.handle.net/21.11116/0000-0008-1863-E
%R 10.1109/CVPR46437.2021.00990
%D 2021
%B 34th IEEE Conference on Computer Vision and Pattern Recognition
%Z date of event: 2021-06-19 - 2021-06-25
%C Nashville, TN, USA (Virtual)
%B IEEE/CVF Conference on Computer Vision and Pattern Recognition
%P 10029 - 10038
%I IEEE
%@ 978-1-6654-4509-2