I had the same problem, and it seems I've found where's the problem. Try this:

Open the Options window (Utilities -> Options). On the Tune-Ups tab, check off the "Cache groups and layers" checkbox.

Seems this very caching is freezing Xara on some machines.