Unfortunately this is the law, unless you have the evidence to proof your ex either violent or sexual abuse the kid, he has the right to 'access' including staying over.
I have the similar situation, my lawyer advised me that just let him have the right, once he get what he argue for, do you think he will take and keep doing what he promise? Even give him the 'access' I am sure a few weeks or months later he will have so many excuses not to visit or staying over to his place..
Are you entitled to 'Legal Aid'? I would suggest that you should consult another solicitor, my solicitor is really good and she got the heart to help me, please don't delete me as I am not here to advertise, I just want to share my experience as I have had so much problems dealing with my divorce for the past a few months; I can understand how helpless and difficult for the girls here facing the same difficulties as my case.