What's funny for one person is not always funny for everyone else.
Anyway, I actually agree with Joe partially. I suggest you go down to Wakefield to one of their open days. Check here for upcoming days.
$50 for the licence, $90 I think for the day on the track, you can hire a helmet there or borrow one off a mate. Drive around and report back to us on the fun you had.
Now if you get into it this may not be the best value long term but it's one of the cheapest ways to start.
The alternative as suggested by a number of people here is joining a club, this one or another, and going to their events. For this you will get a bunch of nice people to hang out with and ask advice from. There are plenty of little tips that people can tell you from their own experiences that can make it more fun for you.
The Texikhana we have coming up is another good event. Last year a Toyota Starlet came 2nd. It's basically a road trip/weekend away and plenty of fun.