Junchi Yao

Beyond State Consistency: Behavior Consistency in Text-Based World Models

Youling Huang, Guanqiao Chen, Junchi Yao, et al.

UGID: Unified Graph Isomorphism for Debiasing Large Language Models

Zikang Ding, Junchi Yao, Junhao Li, et al.

This paper addresses social biases embedded in large language models by proposing UGID, a method that treats the model's internal structure as a graph and forces it to process similar inputs (that differ only in sensitive attributes like gender or race) in the same way. The approach works by constraining both the attention mechanisms and hidden representations in bias-sensitive areas of the model, while using special techniques to prevent the model from losing its core knowledge and safety features.