Yes, there's several free forum software available on-line. You'll find some that offer an all in one package, forum and hosting both included (ie proboards). SimpleMachines, phpbb, are two forum software packages that are free. (Note - there are also others besides the two I've just mentioned.) You'll need to do your research on all the available forum software packages out there to find the one that suits your needs best.
If you chose to buy your own hosting package for your forum, I'd suggest that you start by buying a small package with the option of upgrading your hosting package at any time, just in case your forum takes off and you find yourself in need of more bandwith/space and so on. A great place to do a search on various hosting companies is webhostingtalk.
The start off cost if you choose to go with a free forum software will be minimal. If you get one hosted for free then it will be even cheaper but if you buy your own hosting you should be able to find a reliable host to meet your needs at a relatively low cost (ie under $10.00 a month)
In regards to how difficult will it be at first to administor your forum software, it will all depend on which software you choose. Some are a little easier to get the hang of then others are, but on the whole they are relatively simple to figure out.
Good luck with your new venture.
