Publications

A list of the lab’s research output since its inception. The list is generated automatically from dblp and refreshed weekly, so it may lag a few days behind the most recent acceptances.

79 publications · dblp · Google Scholar

202610

• Hybrid Representation Learning for Information Extraction
  Tobias Deußer
  PhD ThesisUniversity of Bonn
• Quantum Computing from Hopfield Nets - A Textbook with Python Code Examples
  Christian Bauckhage, Rafet Sifa
  BookCognitive Technologies, SpringerFraunhofer Publica
• Towards Reliable Machine Translation: Scaling LLMs for Critical Error Detection and Safety
  Muskaan Chopra, Lorenz Sparrenberg, Rafet Sifa
  ECIRdblp
• Grokking Is a Geometric Phase Transition: Archetypal Analysis Reveals Causal Structure in Transformer Representations
  Lorenz Sparrenberg, Tobias Deußer, Rafet Sifa
  ECML PKDDbonndocdblp
• Is continuous CoT better suited for multilingual reasoning?
  Ali Hamza Bashir, Behzad Shomali, Markus Frey, Mehdi Ali, Rafet Sifa, David Berghaus
  ICLR Workshops
• Knowing When Not to Predict: Self Supervised Learning and Abstention for Safer DR Screening
  Muskaan Chopra, Lorenz Sparrenberg, Jan H. Terheyden, Rafet Sifa
  IJCAI/ECAIdblp
• Generalizing Abstention for Noise-Robust Learning in Medical Image Segmentation
  Wesam Moustafa, Hossam Elsafty, Helen Schneider, Lorenz Sparrenberg, Rafet Sifa
  MIDL
• Domain-Adaptation through Synthetic Data: Fine-Tuning Large Language Models for German Law
  Ali Hamza Bashir, Muhammad Rehan Khalid, Kostadin Cvejoski, Jana Birr, Jule Berghaus, Armin Berger, Sandra Halscheidt, Christian Temath, Rafet Sifa, David Berghaus
  Preprintdblp
• Hybrid Deep Learning for Traceability and Classification of Industrial Slate Tiles
  Soren Antebi, Stefan Eickeler, Sandra Halscheidt, Rene Schmitz, Michael Muellers, Dirk Hecker, Rafet Sifa
  Preprintdblp
• Modalities, a PyTorch-native Framework For Large-scale LLM Training and Research
  Max Lübbering, Timm Ruland, Richard Rutmann, Felix Stollenwerk, David Fitzek, Michael Fromm, Alexander Arno Weber, Rafet Sifa, Nicolas Flores-Herr, Joachim Köhler, Mehdi Ali
  Preprintdblp

202532

• Deep Representation Learning for Financial Document Analytics
  Lars Hillebrand
  PhD ThesisUniversity of Bonn
• Linguistically Aware and Augmentation-Driven Methods for Enhancing Natural Language Understanding
  Maren Pielka
  PhD ThesisUniversity of Bonn
• Resource-Efficient Anonymization of Textual Data via Knowledge Distillation from Large Language Models
  Tobias Deußer, Max Hahnbück, Tobias Uelwer, Cong Zhao, Christian Bauckhage, Rafet Sifa
  COLING (Industry)Fraunhofer Publicadblp
• Bridging Language and Scenes through Explicit 3-D Model Construction
  Tiansi Dong, Writwick Das, Rafet Sifa
  COLING Workshopsdblp
• MultiProp Framework: Ensemble Models for Enhanced Cross-Lingual Propaganda Detection in Social Media and News using Data Augmentation, Text Segmentation, and Meta-Learning
  Farizeh Aldabbas, Shaina Ashraf, Rafet Sifa, Lucie Flek
  COLING Workshopsdblp
• Proceedings of Bridging Neurons and Symbols for Natural Language Processing and Knowledge Graphs Reasoning @ COLING 2025
  Kang Liu, Yangqiu Song, Zhen Han, Rafet Sifa, Shizhu He, Yunfei Long
  COLING Workshopsdblp
• A Survey on Current Trends and Recent Advances in Text Anonymization
  Tobias Deußer, Lorenz Sparrenberg, Armin Berger, Max Hahnbück, Christian Bauckhage, Rafet Sifa
  DSAAbonndocdblp
• First Investigation of Deep Learning for Intraoperative Gauze Segmentation in Minimally Invasive Abdominal Surgery
  Priya Tomar, Maximilian Broß, Philipp Feodorovici, Jan Arensmeyer, Philipp Leifels, Aditya Parikh, Hanno Matthaei, Christian Bauckhage, Helen Schneider, Rafet Sifa
  DSAAdblp
• Predicting Player Churn with LLMs: A Comprehensive Evaluation of World Knowledge and Reasoning
  Tobias Schneider, Lorenz Sparrenberg, Rafet Sifa
  DSAAFraunhofer Publicadblp
• Reasoning LLMs in the Medical Domain: A Literature Survey
  Armin Berger, Sarthak Khanna, Lorenz Sparrenberg, Tobias Deußer, David Berghaus, Rafet Sifa
  DSAAdblp
• Small and Fast LLMs on Commodity Hardware: Post-Training Quantization in llama. cpp
  Lorenz Sparrenberg, Tobias Deußer, Armin Berger, Rafet Sifa
  DSAAbonndocdblp
• Towards Unified Multimodal Financial Forecasting: Integrating Sentiment Embeddings and Market Indicators via Cross-Modal Attention
  Sarthak Khanna, Armin Berger, David Berghaus, Tobias Deußer, Lorenz Sparrenberg, Rafet Sifa
  DSAAdblp
• Teuken-7B-Base & Teuken-7B-Instruct: Towards European LLMs
  Mehdi Ali, Michael Fromm, Klaudia Thellmann, Jan Ebert, Alexander Arno Weber, Richard Rutmann, Charvi Jain, Max Lübbering, Daniel Steinigen, Johannes Leveling, Katrin Klug, Jasper Schulze Buschhoff, Lena Jurkschat, Hammam Abdelwahab, Benny Jörg Stein, Karl-Heinz Sylla, Pavel Denisov, Nicolo' Brandizzi, Qasid Saleem, Anirban Bhowmick, Lennard Helmer, Chelsea Maria John, Pedro Ortiz Suarez, Malte Ostendorff, Alex Jude, Lalith Manjunath, Samuel Weinbach, Carolin Penke, Oleg Filatov, Fabio Barth, Paramita Mirza, Lucas Weber, Ines Wendler, Rafet Sifa, Fabian Küch, Andreas Herten, René Jäkel, Georg Rehm, Stefan Kesselheim, Joachim Köhler, Nicolas Flores-Herr
  ECAIFraunhofer Publicadblp
• Improving Language Model Performance by Training on Prototypical Contradictions
  Maren Pielka, Marie-Christin Freischlad, Svetlana Schmidt, Rafet Sifa
  ECIRdblp
• Judging Quality Across Languages: A Multilingual Approach to Pretraining Data Filtering with Language Models
  Mehdi Ali, Manuel Brack, Max Lübbering, Elias Wendt, Abbas Goher Khan, Richard Rutmann, Alex Jude, Maurice Kraus, Alexander Arno Weber, Felix Stollenwerk, David Kaczér, Florian Mai, Lucie Flek, Rafet Sifa, Nicolas Flores-Herr, Joachim Köhler, Patrick Schramowski, Michael Fromm, Kristian Kersting
  EMNLPdblp
• Informed Deep Abstaining Classifier: Investigating Noise-Robust Training for Diagnostic Decision Support Systems Systems
  Helen Schneider, Sebastian Nowak, Aditya Parikh, Yannik C. Layer, Maike Theis, Wolfgang Block, Alois M. Sprinkart, Ulrike I. Attenberger, Rafet Sifa
  ICONIPdblp
• Architectural Proposal for Reproducible, Standardized Deep Learning Research
  Max Lübbering, Vijul Shah, Moinam Chatterjee, Priya Priya, Osama Soliman, Rafet Sifa
  ICSA Companiondblp
• ArDia: Improving Arabic Dialectal Language Classification Using a Novel Dataset
  Hossam Elsafty, Bouthaina Abdou, Tobias Deußer, Maren Pielka, Christian Bauckhage, Rafet Sifa
  ICWSMdblp
• Arabic OCR in the Age of Multimodal Models: A Comprehensive Comparative Evaluation
  Hossam Elsafty, Farizeh Aldabbas, Rafet Sifa
  IEEE Big Datadblp
• From Retinal Pixels to Patients: Evolution of Deep Learning Research in Diabetic Retinopathy Screening
  Muskaan Chopra, Lorenz Sparrenberg, Armin Berger, Sarthak Khanna, Jan H. Terheyden, Rafet Sifa
  IEEE Big Datadblp
• History Rhymes: Macro-Contextual Retrieval for Robust Financial Forecasting
  Sarthak Khanna, Armin Berger, Muskaan Chopra, David Berghaus, Rafet Sifa
  IEEE Big Datadblp
• How Small Can You Go? Compact Language Models for On-Device Critical Error Detection in Machine Translation
  Muskaan Chopra, Lorenz Sparrenberg, Sarthak Khanna, Rafet Sifa
  IEEE Big Datadblp
• Leveraging Synthetically Generated Data for Real Estate Document Classification
  Tobias Deußer, Gregor Ramien, Nico Weber, Maximilian Meidinger, Max Hahnbück, Christian Bauckhage, Rafet Sifa
  IEEE Big Databonndocdblp
• Leveraging Transfer Learning with Class-Specific Decoders for Laparoscopic Segmentation
  Priya Tomar, Aditya Parikh, Christian Bauckhage, Rafet Sifa
  IEEE Big Datadblp
• Multi-Modal Vision vs. Text-Based Parsing: Benchmarking LLM Strategies for Invoice Processing
  David Berghaus, Armin Berger, Lars Hillebrand, Kostadin Cvejoski, Rafet Sifa
  IEEE Big Datadblp
• Towards Automated Recipe Reconstruction: Optimization of Dietary Data Collection using Information Retrieval, Large Language Models and Mathematical Optimization
  Svetlana Schmidt, Linda Klasen, Ute Nöthlings, Rafet Sifa
  IEEE Big Databonndocdblp
• Towards Uncertainty-Aware Low-Bit Quantized LLMs for On-Device Inference
  Lorenz Sparrenberg, Tobias Schneider, Tobias Deußer, Armin Berger, Rafet Sifa
  IEEE Big Databonndocdblp
• Automating translation checks of financial documents using large language models
  Maren Pielka, Max Hahnbück, Tobias Deußer, Daniel Uedelhoven, Moinam Chatterjee, Vijul Shah, Osama Soliman, Jannis von der Bank, Writwick Das, Maria Chiara Talarico, Cong Zhao, Carolina Held Celis, Christian Temath, Rafet Sifa
  Lang. Resour. Evaluationdblp
• SugarViT - Multi-objective regression of UAV images with Vision Transformers and Deep Label Distribution Learning demonstrated on disease severity prediction in sugar beet
  Maurice Günder, Facundo Ramón Ispizua Yamati, Abel Andree Barreto Alcántara, Anne-Katrin Mahlein, Rafet Sifa, Christian Bauckhage
  PLOS ONE
• Benchmark Success, Clinical Failure: When Reinforcement Learning Optimizes for Benchmarks, Not Patients
  Armin Berger, Manuela Bergau, Helen Schneider, Saad Ahmad, Tom Anglim Lagones, Gianluca Brugnara, Martha Foltyn-Dumitru, Kai Schlamp, Philipp Vollmuth, Rafet Sifa
  Preprintdblp
• Interpretable Topic Extraction and Word Embedding Learning using row-stochastic DEDICOM
  Lars Hillebrand, David Biesner, Christian Bauckhage, Rafet Sifa
  Preprintdblp
• SynCED-EnDe 2025: A Synthetic and Curated English - German Dataset for Critical Error Detection in Machine Translation
  Muskaan Chopra, Lorenz Sparrenberg, Rafet Sifa
  Preprintdblp

202418

• Pointer-Guided Pre-training: Infusing Large Language Models with Paragraph-Level Contextual Awareness
  Lars Hillebrand, Prabhupad Pradhan, Christian Bauckhage, Rafet Sifa
  ECML/PKDDdblp
• Informed Deep Abstaining Classifier: Investigating Noise-Robust Training for Diagnostic Decision Support Systems
  Helen Schneider, Sebastian Nowak, Aditya Parikh, Yannik C. Layer, Maike Theis, Wolfgang Block, Alois M. Sprinkart, Ulrike I. Attenberger, Rafet Sifa
  ICONIP
• [Vision Paper] PRObot: Enhancing Patient-Reported Outcome Measures for Diabetic Retinopathy using Chatbots and Generative AI
  Maren Pielka, Tobias Schneider, Jan H. Terheyden, Rafet Sifa
  IEEE Big DataFraunhofer Publicadblp
• A Comparative Study of Large Language Models for Named Entity Recognition in the Legal Domain
  Tobias Deußer, Cong Zhao, Lorenz Sparrenberg, Daniel Uedelhoven, Armin Berger, Maren Pielka, Lars Hillebrand, Christian Bauckhage, Rafet Sifa
  IEEE Big DataFraunhofer Publicadblp
• Advancing Personalized Medicine: A Scalable LLM-based Recommender System for Patient Matching
  Armin Berger, David Berghaus, Ali Hamza Bashir, Lorenz Grigull, Lara Fendrich, Tom Anglim Lagones, Henriette Högl, Gundula Ernst, Ralf Schmidt, David Bascom, Tobias Deußer, Thiago Bell, Max Lübbering, Rafet Sifa
  IEEE Big Databonndocdblp
• Advancing Risk and Quality Assurance: A RAG Chatbot for Improved Regulatory Compliance
  Lars Hillebrand, Armin Berger, Daniel Uedelhoven, David Berghaus, Ulrich Warning, Tim Dilmaghani Khameneh, Bernd Kliem, Thomas Schmid, Rüdiger Loitz, Rafet Sifa
  IEEE Big Datadblp
• Correcting Systematic Bias in LLM-Generated Dialogues Using Big Five Personality Traits
  Lorenz Sparrenberg, Tobias Schneider, Tobias Deußer, Markus Koppenborg, Rafet Sifa
  IEEE Big DataFraunhofer Publicadblp
• Fine-Tuning Large Language Models for Compliance Checks
  Thiago Bell, David Leonhard, Ali Hamza Bashir, Tim Dilmaghani Khameneh, Mohamed Khaled, Ulrich Warning, Rüdiger Loitz, Sandra Halscheidt, Jana Birr, Armin Berger, Rafet Sifa, David Berghaus
  IEEE Big DataFraunhofer Publicadblp
• Fusing Speech and Language Models for Dementia Detection
  Tobias Deußer, Abdul Mohsin Siddiqi, Lorenz Sparrenberg, Tobias Adams, Christian Bauckhage, Rafet Sifa
  IEEE Big DataFraunhofer Publicadblp
• Informed Named Entity Recognition Decoding for Generative Language Models
  Tobias Deußer, Lars Hillebrand, Christian Bauckhage, Rafet Sifa
  IEEE Big DataFraunhofer Publicadblp
• Insights About Causality Detection in Financial Text - Towards an Informed Approach
  Maren Pielka, Rafet Sifa
  IEEE Big DataFraunhofer Publicadblp
• Leveraging Large Language Models for Few-Shot KPI Extraction from Financial Reports
  Tobias Deußer, Cong Zhao, Daniel Uedelhoven, Lorenz Sparrenberg, Lars Hillebrand, Christian Bauckhage, Rafet Sifa
  IEEE Big DataFraunhofer Publicadblp
• Model-agnostic Body Part Relevance Assessment for Pedestrian Detection Model Benchmarking
  Maurice Günder, Sneha Banerjee, Rafet Sifa, Christian Bauckhage
  IEEE Big Datadblp
• Optimizing Rare Disease Patient Matching with Large Language Models
  Armin Berger, Ali Hamza Bashir, David Berghaus, Mowmita, Nazia Afsan, Lorenz Grigull, Lara Fendrich, Henriette Högl, Gundula Ernst, Ralf Schmidt, David Bascom, Tom Anglim Lagones, Tobias Deußer, Thiago Bell, Max Lübbering, Rafet Sifa
  IEEE Big Databonndocdblp
• Table Structure Recognition via Encoder/Decoder Vision Transformers
  Daniel Uedelhoven, Max Lübbering, Christian Bauckhage, Rafet Sifa
  IEEE Big Datadblp
• Tackling Data Sparsity and Combinatorial Challenges in Rare Disease Matching with Medical Informed Machine Learning
  Armin Berger, Tom Anglim Lagones, Lorenz Grigull, Lara Fendrich, Thiago Bell, Henriette Högl, Gundula Ernst, Ralf Schmidt, David Bascom, Rafet Sifa, Max Lübbering
  IEEE Big Datadblp
• Word Sense Disambiguation as a Game of Neurosymbolic Darts
  Tiansi Dong, Rafet Sifa
  LREC-COLING Workshops
• Tokenizer Choice For LLM Training: Negligible or Crucial?
  Mehdi Ali, Michael Fromm, Klaudia Thellmann, Richard Rutmann, Max Lübbering, Johannes Leveling, Katrin Klug, Jan Ebert, Niclas Doll, Jasper Schulze Buschhoff, Charvi Jain, Alexander Arno Weber, Lena Jurkschat, Hammam Abdelwahab, Chelsea Maria John, Pedro Ortiz Suarez, Malte Ostendorff, Samuel Weinbach, Rafet Sifa, Stefan Kesselheim, Nicolas Flores-Herr
  NAACL-HLT (Findings)dblp

202319

• Improving Zero-Shot Text Matching for Financial Auditing with Large Language Models
  Lars Hillebrand, Armin Berger, Tobias Deußer, Tim Dilmaghani Khameneh, Mohamed Khaled, Bernd Kliem, Rüdiger Loitz, Maren Pielka, David Leonhard, Christian Bauckhage, Rafet Sifa
  DocEngFraunhofer Publicadblp
• Towards Linguistically Informed Multi-objective Transformer Pre-training for Natural Language Inference
  Maren Pielka, Svetlana Schmidt, Lisa Pucknat, Rafet Sifa
  ECIRdblp
• Segmentation and Analysis of Lumbar Spine MRI Scans for Vertebral Body Measurements
  Helen Schneider, David Biesner, Akash Ashokan, Maximilian Broß, Rebecca Kador, Sandra Halscheidt, Gabor Bagyo, Peter Dankerl, Haissam Ragab, Jin Yamamura, Christoph Labisch, Rafet Sifa
  ESANNdblp
• sustain.AI: a Recommender System to analyze Sustainability Reports
  Lars Hillebrand, Maren Pielka, David Leonhard, Tobias Deußer, Tim Dilmaghani Khameneh, Bernd Kliem, Rüdiger Loitz, Milad Morad, Christian Temath, Thiago Bell, Robin Stenzel, Rafet Sifa
  ICAILFraunhofer Publicadblp
• Symmetry-Aware Siamese Network: Exploiting Pathological Asymmetry for Chest X-Ray Analysis
  Helen Schneider, Elif Cansu Yildiz, David Biesner, Yannik C. Layer, Benjamin Wulff, Sebastian Nowak, Maike Theis, Alois M. Sprinkart, Ulrike I. Attenberger, Rafet Sifa
  ICANNdblp
• Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimization
  Rajkumar Ramamurthy, Prithviraj Ammanabrolu, Kianté Brantley, Jack Hessel, Rafet Sifa, Christian Bauckhage, Hannaneh Hajishirzi, Yejin Choi
  ICLRdblp
• Controlled Randomness Improves the Performance of Transformer Models
  Tobias Deußer, Cong Zhao, Wolfgang Krämer, David Leonhard, Christian Bauckhage, Rafet Sifa
  ICMLAFraunhofer Publicadblp
• A Comparative Analysis of Data Augmentation Approaches for Improved Minority Behavior Detection in Digital Games
  Rafet Sifa, Edwin Yang
  IEEE Big Datadblp
• Generating Prototypes for Contradiction Detection Using Large Language Models and Linguistic Rules
  Maren Pielka, Svetlana Schmidt, Rafet Sifa
  IEEE Big Datadblp
• Is one label all you need? Single positive multi-label training in medical image analysis
  Helen Schneider, Priya Priya, David Biesner, Rebecca Kador, Yannik C. Layer, Maike Theis, Sebastian Nowak, Alois M. Sprinkart, Ulrike I. Attenberger, Rafet Sifa
  IEEE Big Datadblp
• Learning the Dynamics of Concentration Fields in Vascular Stenosis with Deep Hidden Physics Models
  Rebecca Kador, Helen Schneider, David Biesner, Babette Dellen, Rafet Sifa
  IEEE Big Datadblp
• Towards Automated Regulatory Compliance Verification in Financial Auditing with Large Language Models
  Armin Berger, Lars Hillebrand, David Leonhard, Tobias Deußer, Thiago Bell Felix de Oliveira, Tim Dilmaghani Khameneh, Mohamed Khaled, Bernd Kliem, Rüdiger Loitz, Christian Bauckhage, Rafet Sifa
  IEEE Big Datadblp
• Towards Retention Analysis in NFT-based Blockchain Games
  Rafet Sifa, Fabian Hadiji
  IEEE Big Datadblp
• Uncovering Inconsistencies and Contradictions in Financial Reports using Large Language Models
  Tobias Deußer, David Leonhard, Lars Hillebrand, Armin Berger, Mohamed Khaled, Sarah Heiden, Tim Dilmaghani Khameneh, Bernd Kliem, Rüdiger Loitz, Christian Bauckhage, Rafet Sifa
  IEEE Big DataFraunhofer Publicadblp
• Matching Experts to Questions: A Comparison of Recommender Systems
  Robin Stenzel, Max Lübbering, Bilge Ulusay, Daniel Uedelhoven, Rafet Sifa
  LWDAdblp
• Towards Informed Pre-Training for Critical Error Detection in English-German
  Lisa Pucknat, Maren Pielka, Rafet Sifa
  LWDAdblp
• Automatic Consistency Checking of Table and Text in Financial Documents
  Syed Musharraf Ali, Tobias Deußer, Sebastian Houben, Lars Patrick Hillebrand, Tim Metzler, Rafet Sifa
  NLDLFraunhofer Publicadblp
• Contradiction Detection in Financial Reports
  Tobias Deußer, Maren Pielka, Lisa Pucknat, Basil Jacob, Tim Dilmaghani Khameneh, Mahdis Nourimand, Bernd Kliem, Rüdiger Loitz, Christian Bauckhage, Rafet Sifa
  NLDLFraunhofer Publicadblp
• Improving Natural Language Inference in Arabic Using Transformer Models and Linguistically Informed Pre-Training
  Mohammad Majd Saad Al Deen, Maren Pielka, Jörn Hees, Bouthaina Soulef Abdou, Rafet Sifa
  SSCIdblp