Step 1:

With multiple layers selected, click the “Move Randomly” button from the floaty.

Step 2:

Move your mouse cursor left and right to move your layers around in random directions.

Scroll to change your random seed

You may have noticed the scroll indicator appear on the bottom left side of the panel. Scrolling while the operation is ongoing will create a new random seed, allowing you to test out a different random pattern.