I like a website called www.hardtofind.com.au which has some really cool gift ideas in. There's a few UK websites I like too, but the postage over to Australia can be a bit steep. www.notonthehighstreet.com is a cool little site, but I use this mostly for inspiration rather than to buy on (too costly for delivery). I love online 'window' shopping as you seem to be able to get inspiration really quickly without having to tour a million shops (and the crowds)
Shop Jeen is a fun and quirky American online store that has $10 flat-rate international shipping. I've gotten a few gifts from there that I've never seen anywhere else, and they've gone down well with the recipients. I also like Think Geek, but they are also American and their international shipping can get really expensive.
For Australian sites, http://shop.until.com.au often has some really fun things. As does http://www.top3.com.au .
I love Fiverr.com. They have an epic range of offerings such as personalised songs and videos, cartoons, paintings, arts and crafts and hundreds of other ideas including some truly quirky ones. Mostly the price is US$5 although you can pay more for extras and fast delivery.
Definitely, as just about everyone else has mentioned, Etsy is a great spot to find quirky and affordable gifts. Other spots that jump to mind include Pigeonhole ( http://www.pigeonhole.com/ ), She Seldom Blushes ( http://sheseldomblushes.com.au/shop/ ) and Ruck Rover General Store ( http://shop.ruckrover.com.au/ ). For exquisite Russian nesting dolls and other traditional crafts check out Russian Crafts ( http://russian-crafts.com/ ) and while the Oxfam online shop ( http://www.oxfamshop.org.au/?utm_source=OA&utm_medium=shoppage-nav&utm_campaign=Jan-Sale-2014 ) has gorgeous fair-trade goodies from all around the world. Ebay also has some real gems that are difficult to find elsewhere. .