I think it's fine. I run several dedicated servers and 44% is not too bad at all. Of course the issue is spikes in the load. If you're running forums you'll see above average memory usage, and the main culprit is usually mysql queries.
In case you ever do need to upgrade, if you're satisfied with the general speed of the site have a look at the cost of increasing just the ram vs a whole new server.