We go camping with a group of either family or friends all the time, in fact, we have never gone camping with just 'us'! We find that with kids they eat at different times and eat different food so we always do dinner on our own.
We would go about our day, sometimes doing what they were doing, sometimes on our own, but usually always meet up for afternoon drinks with cheese and crackers...lol.
This is usually "put on the table what you have and everyone dig in". When the kids needed dinner we would go back to our camp, feed them then after dinner meet back up with everyone for more drinks and a lot of laughter.
During the day when everyone gets a bit too much for me, including my own family, ( i like some solitude) i find a quiet spot and read. My husband goes for a fish when he needs time to himself.
This works for us, it might for you too.