"No problem can be solved from the same level of consciousness that created it." - Albert Einstein
In some cases, guilt is felt whenever we feel that we are being blamed for something. Then we react. That is viewing from a personal or first person's point of view.
This feeling of being blamed is a normal reaction in situations where a serious issue is being brought up on the table. But I think the truth is we feel guilty because there is a subliminal acknowledgment of an unaccomplished task.
Blaming becomes a reasonable excuse. An emotional defense mechanism. Heated arguments begin when minds close.
My personal approach to guilt is to channel my thoughts positively by understanding the above. When I feel guilty, I try to exert an extra effort to listen more about the situation and find a solution instead of arguing who is right about what.
This attitude does more wonders than simply arguing about an issue for the sake of proving something.
"The greatest challenge to any thinker is stating the problem in a way that will allow a solution." - Bertrand Russell