The patterns and text with effects can be converted to editable shapes (make a text copy on the pasteboard in case you need to edit later), this will stop them being repelled.
Or, just don't use...