Dusty Baker says he hasn't thought about potential altercations with Giants