Sounds like you're up for a fun trip, but if you do Hill End its a great trip. Close to Mudgee (go to the cellar door winery - the one which looks like a bee hive and sells honey as it has the greatest Muscat, perfect for round the camp fire of an evening)
You also have Munghorn Gap quite close which is great for bird watching. There are a couple of camp grounds there, and the one a little out of town is far better than the one in town. Stay on the Hill there somewhere as if you stay on the flat part in the middle you are likely to get lots of fog and frost.
Some great stuff to see just walking around the town and you should also do the gold mine tour which is very good and also cheap.
If you have a 4 x 4 Dixons Long Point rd is a good trip as is the Bridle Track.