If agents negotiate openly and form coalitions, can they reach efficient agreements? We address this issue within a class of coalition formation games with externalities where agents' preferences depend solely on the coalition structures they are associated with. We derive Ray and Vohra's (1997) notion of equilibrium binding agreements using von Neumann and Morgenstern abstract stable set and then extend it to allow for arbitrary coalitional deviations (as opposed to nested deviations assumed originally). We show that, while the new notion facilitates the attainment of efficient agreements, inefficient agreements can nevertheless arise.