Even if your boss is interested in you, but you are not interested in him, I don't find any problems wor. As long as he didn't sexually harass you. That's totally fine. You only have to worry if you started to have feelings in him, that's a big problem. He can't do anything to you if you don't have feelings in him, I don't understand why you are scared wor !!