publications

2022

1. NeurIPS

   Towards Improving Calibration in Object Detection Under Domain Shift

   Munir, Muhammad AKhtar, Khan, Muhammad Haris, Sarfraz, M Saquib, and Ali, Mohsen

   In 36th Conference on Neural Information Processing Systems (NeurIPS) 2022

   Abs HTML PDF Code

   The increasing use of deep neural networks in safety-critical applications requires the trained models to be well-calibrated. Most current calibration techniques address classification problems while focusing on improving calibration on in-domain predictions. Little to no attention is paid towards addressing calibration of visual object detectors which occupy similar space and importance in many decision making systems. In this paper, we study the calibration of current object detection models, particularly under domain shift. To this end, we first introduce a plug-and-play train-time calibration loss for object detection. It can be used as an auxiliary loss function to improve detector’s calibration. Second, we devise a new uncertainty quantification mechanism for object detection which can implicitly calibrate the commonly used self-training based domain adaptive detectors. We include in our study both single-stage and two-stage object detectors. We demonstrate that our loss improves calibration for both in-domain and out-of-domain detections with notable margins. Finally, we show the utility of our techniques in calibrating the domain adaptive object detectors in diverse domain shift scenarios.

2. CVPR

   Hierarchical Nearest Neighbor Graph Embedding for Efficient Dimensionality Reduction

   Sarfraz, M Saquib, Koulakis, Marios, Seibold, Constantin, and Stiefelhagen, Rainer

   In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022

   HTML PDF Code
3. MICCAI

   Breaking with Fixed Set Pathology Recognition through Report-Guided Contrastive Training

   Seibold, Constantin, Reiß, Simon, Sarfraz, M Saquib, Stiefelhagen, Rainer, and Kleesiek, Jens

   In 25th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) 2022

   HTML PDF
4. BMVC

   Detailed Annotations of Chest X-Rays via CT Projection for Report Understanding

   Seibold, Constantin, Reiß, Simon, Sarfraz, M Saquib, Finck, Matthias A, Mayer, Victoria, Sellner, Jan, Kim, Moon Sung, Maier-Hein, Klaus H, Kleesiek, Jens, and Stiefelhagen, Rainer

   In Proceedings of the 33th British Machine Vision Conference (BMVC) 2022

   HTML PDF Code
5. CVPRW

   Pose-Based Contrastive Learning for Domain Agnostic Activity Representations

   Schneider, David, Sarfraz, M Saquib, Roitberg, Alina, and Stiefelhagen, Rainer

   In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Worshops 2022

   HTML PDF Code
6. Journal

   Comparison of CNNs and Vision Transformers-Based Hybrid Models Using Gradient Profile Loss for Classification of Oil Spills in SAR Images

   Basit, Abdul, Siddique, Muhammad Adnan, Bhati, M Khurram, and Sarfraz, M Saquib

   Remote Sensing 2022

   HTML PDF

2021

1. NeurIPS

   Synergizing between Self-Training and Adversarial Learning for Domain Adaptive Object Detection

   Munir, Muhammad AKhtar, Khan, Muhammad Haris, Sarfraz, M Saquib, and Ali, Mohsen

   In 35th Conference on Neural Information Processing Systems (NeurIPS) 2021

   Abs HTML PDF Code

   We study adapting trained object detectors to unseen domains manifesting significant variations of object appearance, viewpoints and backgrounds. Most current methods align domains by either using image-level or instance-level feature alignment in an adversarial fashion. This often suffers due to the presence of unwanted background and as such lacks class-specific alignment since the target domain is unlabelled. A common remedy to promote class-level alignment is to use high confidence predictions on the new domain as pseudo labels. These high confidence predictions are often fallacious since the model is poorly calibrated under domain shift. In this paper, we propose to leverage model’s predictive uncertainty to strike the right balance between adversarial feature alignment and class-level alignment. Specifically, we measure predictive uncertainty on class assignments and the bounding box predictions. Certain predictions are used to generate pseudo labels for self-supervision, whereas the uncertain ones are used to generate tiles for an adversarial feature alignment stage. This synergy between tiling around the uncertain object regions and generating pseudo-labels from certain object regions allows us to capture both the image and instance level context during the model adaptation stage. We perform extensive experiments covering various domain shift scenarios. Our approach improves upon existing state-of-the-art methods with visible margins.

2. CVPR

   Temporally-Weighted Hierarchical Clustering for Unsupervised Action Segmentation

   Sarfraz, M Saquib, Murray, Naila, Sharma, Vivek, Diba, Ali, Van Gool, Luc, and Stiefelhagen, Rainer

   In IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR) 2021

   HTML PDF Code
3. ICCV

   Vi2CLR: Video and Image for Visual Contrastive Learning of Representation

   Diba, Ali, Safdari, Reza, Lofti, Dariush, Sharma, Vivek, Sarfraz, M Saquib, Van Gool, Luc, and Stiefelhagen, Rainer

   In IEEE/CVF International Conference on Computer Vision (ICCV) 2021

   HTML PDF
4. WACV

   Unsupervised Meta-Domain Adaptation for Fashion Retrieval

   Sharma, Vivek, Murray, Naila, Larlus, Diane, Sarfraz, M Saquib, Stiefelhagen, Rainer, and Csurka, Gabriela

   In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision 2021

   HTML PDF Code
5. IGARSS

   Deep learning based oil spill classification using UNet Convolutional Neural Network

   Basit, Abdul, Siddique, Muhammad Adnan, and Sarfraz, M Saquib

   In IEEE International Geoscience and Remote Sensing Symposium 2021

   HTML

2020

1. FG

   Clustering based contrastive learning for improving face representations

   Sharma, Vivek, Tapaswi, Makarand, Sarfraz, M Saquib, and Stiefelhagen, Rainer

   In IEEE International Conference on Automatic Face and Gesture Recognition (FG) 2020

   HTML PDF
2. BMVC

   Anchor-free Small-scale Multispectral Pedestrian Detection

   Wolpert, Alexander, Teutsch, Michael, Sarfraz, M Saquib, and Stiefelhagen, Rainer

   In British Machine Vision Conference, (BMVC) 2020

   HTML PDF Code

2019

1. CVPR

   Efficient parameter-free clustering using first neighbor relations

   Sarfraz, M Saquib, Sharma, Vivek, and Stiefelhagen, Rainer

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2019

   HTML PDF Code
2. BMVC

   

   Content and Colour Distillation for Learning Image Translations with the Spatial Profile Loss

   Sarfraz, M Saquib, Seibold, Constantin, Khalid, Haroon, and Stiefelhagen, Rainer

   In 30th British Machine Vision Conference, (BMVC) 2019

   HTML PDF Code Best Industry Paper Award
3. FG

   

   Self-supervised learning of face representations for video face clustering

   Sharma, Vivek, Tapaswi, Makarand, Sarfraz, M Saquib, and Stiefelhagen, Rainer

   In 14th IEEE International Conference on Automatic Face \& Gesture Recognition (FG) 2019

   PDF Code Best Paper Award
4. Journal

   Video face clustering with self-supervised representation learning

   Sharma, Vivek, Tapaswi, Makarand, Sarfraz, M Saquib, and Stiefelhagen, Rainer

   IEEE Transactions on Biometrics, Behavior, and Identity Science 2019

   PDF
5. EMBC

   Vision-based mouth motion analysis in epilepsy: A 3D perspective

   Ahmedt-Aristizabal, David, Nguyen, Kien, Denman, Simon, Sarfraz, M Saquib, Sridharan, Sridha, Dionisio, Sasha, and Fookes, Clinton

   In 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) 2019

   HTML
6. EMBC

   Motion Signatures for the Analysis of Seizure Evolution in Epilepsy

   Ahmedt-Aristizabal, David, Sarfraz, M Saquib, Denman, Simon, Nguyen, Kien, Fookes, Clinton, Dionisio, Sasha, and Stiefelhagen, Rainer

   In 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) 2019

   HTML
7. EPSA

   Beyond text as data: Automated video analysis for research on legislative politics

   Nyhuis, Dominic, Behrens, Lion, Gschwend, Thomas, Ringwald, Tobias, Sarfraz, M Saquib, and Stiefelhagen, Rainer

   In 9th Annual Conference of the European Political Science Association 2019

   HTML

2018

1. CVPR

   A pose-sensitive embedding for person re-identification with expanded cross neighborhood re-ranking

   Sarfraz, M Saquib, Schumann, Arne, Eberle, Andreas, and Stiefelhagen, Rainer

   In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018

   HTML PDF Code
2. ICME

   Icme grand challenge results on heterogeneous face recognition: Polarimetric thermal-to-visible matching

   Riggan, Benjamin S, Short, Nathaniel J, Sarfraz, M Saquib, Hu, Shuowen, Zhang, He, Patel, Vishal M, Rasnayaka, Sanka, Li, Jing, Sim, Terence, Iranmanesh, Seyed Mehdi, and others,

   In 2018 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) 2018
3. TRECVID

   PLUMCOT at TRECVid Instance Search 2018.

   Bredin, Herv{\'e}, Maurice, Benjamin, Yin, Ruiqing, Guinaudeau, Camille, Behre, Aman, Barras, Claude, Sharma, Vivek, and Sarfraz, M Saquib

   In TRECVID 2018

   PDF

2017

1. IJCV

   Deep perceptual mapping for cross-modal face recognition

   Sarfraz, M Saquib, and Stiefelhagen, Rainer

   International Journal of Computer Vision (IJCV) 2017

   HTML PDF Press/Media
2. CVPRW

   A simple and effective technique for face clustering in tv series

   Sharma, Vivek, Sarfraz, M Saquib, and Stiefelhagen, Rainer

   In CVPR Workshop on Brave New Motion Representations 2017

   PDF
3. FG

   Heterogeneous face recognition: recent advances in infrared-to-visible matching

   Hu, Shuowen, Short, Nathaniel, Riggan, Benjamin S, Chasse, Matthew, and Sarfraz, M Saquib

   In 12th IEEE International Conference on Automatic Face and Gesture Recognition (FG) 2017

   HTML
4. BMVC

   Deep view-sensitive pedestrian attribute inference in an end-to-end model

   Sarfraz, M Saquib, Schumann, Arne, Wang, Yan, and Stiefelhagen, Rainer

   In British Machine Vision Conference, (BMVC) 2017

   HTML PDF
5. Journal

   A multimodal assistive system for helping visually impaired in social interactions

   Sarfraz, M Saquib, Constantinescu, Angela, Zuzej, Melanie, and Stiefelhagen, Rainer

   Informatik-Spektrum 2017

   PDF

2015

1. Journal

   Exploiting colour information for better scene text detection and recognition

   Fraz, Muhammad, Sarfraz, M Saquib, and Edirisinghe, Eran A

   International Journal on Document Analysis and Recognition (IJDAR) 2015

   HTML
2. BMVC

   

   Deep perceptual mapping for thermal to visible face recognition

   Sarfraz, M Saquib, and Stiefelhagen, Rainer

   In 26th British Machine Vision Conference, (BMVC) 2015

   HTML PDF Best Industry Paper Award
3. GCPR

   3D Facial Landmark Detection: How to Deal with Head Rotations?

   Schwarz, Anke, Wacker, Esther-Sabrina, Martin, Manuel, Sarfraz, M Saquib, and Stiefelhagen, Rainer

   In German Conference on Pattern Recognition 2015

   HTML

2014

1. BMVC

   Exploiting Color Information for Better Scene Text Recognition

   Fraz, Muhammad, Sarfraz, M Saquib, and Edirisinghe, Eran A

   In 25th British Machine Vision Conference, (BMVC) 2014

   HTML
2. ICPR

   Mid-level-representation based lexicon for vehicle make and model recognition

   Fraz, Muhammad, Edirisinghe, Eran A, and Sarfraz, M Saquib

   In 22nd International Conference on Pattern Recognition 2014

   HTML

2013

1. Journal

   Real-time automatic license plate recognition for CCTV forensic applications

   Sarfraz, M Saquib, Shahzad, Azeem, Elahi, Muhammad A, Fraz, Muhammad, Zafar, Iffat, and Edirisinghe, Eran A

   Journal of real-time image processing 2013

   HTML
2. Journal

   Human object annotation for surveillance video forensics

   Fraz, Muhammad, Zafar, Iffat, Tzanidou, Giounona, Edirisinghe, Eran Anusha, and Sarfraz, Muhammad Saquib

   Journal of Electronic Imaging 2013

   HTML
3. BMVC

   RPM: Random Points Matching for Pair wise Face-Similarity

   Sarfraz, M Saquib, Siddique, Muhammad Adnan, and Stiefelhagen, Rainer

   In 24th British Machine Vision Conference, (BMVC) 2013

   PDF

2012

1. WSCG

   License Plate Detection using NMF with Sparseness constraints through still Images

   Jawad, M, Yasin, M, and Sarfraz, M Saquib

   In International Conferences in Central Europe on Computer Graphics, Visualization and Computer Vision 2012

   HTML
2. IGARSS

   Automatic registration of SAR and optical images based on mutual information assisted Monte Carlo

   Siddique, Muhammad Adnan, Sarfraz, M Saquib, Bornemann, David, and Hellwich, Olaf

   In IEEE International Geoscience and Remote Sensing Symposium 2012

   HTML

2011

1. VISAPP

   Real Time Localization, Tracking and Recognition of Vehicle License Plate

   Shahzad, Azeem, Fraz, Muhammad, Elahi, Muhammad Adnan, and Sarfraz, M Saquib

   In International Conference on Computer VIsion Theory and Applications (VISAPP) 2011

   HTML
2. VISAPP

   A Probabilistic Framework for Patch based Vehicle Type Recognition

   Sarfraz, M Saquib, and Khan, Muhammad Haris

   International Conference on Computer VIsion Theory and Applications (VISAPP) 2011

   HTML
3. Book Chapter

   Towards Unconstrained Face Recognition Using 3D Face Model

   Riaz, Zahid, Sarfraz, M Saquib, and Beetz, Michael

   2011

   HTML
4. VISAPP

   Text Detection in Still Images and CCTV Videos using Local Energy based Shape Histogram Features (LESH)

   Fraz, M, and Sarfraz, M Saquib

   2011

2010

1. ICIET

   Image based vehicle type identification

   Iqbal, U, Zamir, SW, Shahid, MH, Parwaiz, K, Yasin, M, and Sarfraz, MS

   In IEEE International Conference on Information and Emerging Technologies 2010

   HTML
2. Book Chapter

   Feature extraction and representation for face recognition

   Sarfraz, M Saquib, Hellwich, Olaf, and Riaz, Zahid

   2010

   HTML

2009

1. PhD Dissertation

   Towards automatic face recognition in unconstrained scenarios

   Sarfraz, Muhammad Saquib

   2009

   HTML
2. Journal

   Probabilistic learning for fully automatic face recognition across pose

   Sarfraz, M Saquib, and Hellwich, Olaf

   Image and Vision Computing 2009

   HTML
3. FIT

   

   Bayesian prior models for vehicle make and model recognition

   Sarfraz, M Saquib, Saeed, Ahmed, Khan, M Haris, and Riaz, Zahid

   In Proceedings of the 7th International Conference on Frontiers of Information Technology 2009

   HTML Best Paper Award
4. FIT

   Multi-feature fusion in advanced robotics applications

   Riaz, Zahid, Mayer, Christoph, Beetz, Michael, Radig, Bernd, and Sarfraz, M Saquib

   In Proceedings of the 7th International Conference on Frontiers of Information Technology 2009

   HTML

2008

1. VISAPP

   

   Head Pose Estimation in Face Recognition Across Pose Scenarios

   Sarfraz, M Saquib, and Hellwich, Olaf

   International Conference on Computer VIsion Theory and Applications (VISAPP) 2008

   PDF Best Student Paper Award
2. Journal

   An efficient front-end facial pose estimation system for face recognition

   Sarfraz, M Saquib, and Hellwich, Olaf

   Pattern Recognition and Image Analysis 2008

   HTML
3. FG

   Statistical appearance models for automatic pose invariant face recognition

   Sarfraz, M Saquib, and Hellwich, Olaf

   In IEEE International Conference on Automatic Face & Gesture Recognition 2008

   HTML
4. VISIGRAPP

   On head pose estimation in face recognition

   Sarfraz, M Saquib, and Hellwich, Olaf

   In International Conference on Computer Vision and Computer Graphics 2008

   HTML
5. IMTA

   Learning probabilistic models for recognizing faces under pose variations

   Sarfraz, M Saquib, and Hellwich, Olaf

   Proceedings of the Image Mining Theory and Applications 2008

   PDF

2006

1. IIT

   Kullback-Leiber divergence measure in correlation of gray scale objects

   Khalid, M S, Ilyas, M U, Mahmood, K, Sarfraz, M Saquib, and Malik, M.B

   In Int. Conference in Innovation in Information Technology IIT 2006

   PDF
2. Journal

   Kullback-Leiber divergence measure in correlation of gray scale objects

   Khalid, M S, Ilyas, M U, Sarfraz, M Saquib, and Ijaz, M.A

   Int. Journal of Multimeida 2006

2005

1. ICET

   Performance of a Similarity Measure in Grayscale Image Matching

   Khalid, M S, Malik, M.B, Ilyas, M U, Sarfraz, M Saquib, and Mahmood, K

   In IEEE International Conference of Emerging Technologies 2005

   PDF