I learned a long time ago you are judged by the company you keep.  I prefer to stay away from that bunch.  Every company has them.  You are better off to be polite and speak with them regarding business and sheduling matters only.  Your reputation is safer that way.  Take the "down time " and devote it to yourself.  Read a good book, go for a stroll, but stay away from them.  You will be better off.