You can actually swim with them in Rockingham, I think it is called Rockingham Wild Adventures (or similar), and also in Bunbury, Western Australia.
Monkey Mia is a place where you can see the dolphins however you cannot swim with them there.
However, this all depends on whether they find the dolphins on the day you go out, so it is probably a big "however".