I don't really understand your post. You have a physical disability but it does not affect you severely? Do you mean medical problems, or a physical disability?
I have a couple of serious medical problems that strongly affect me, and I guess you could call them a disability. I don't technically know what to call it. I don't live on campus this year, but I will next year if I go to the college that I think I'm going to. I've spoken a lot with disability support services and residence life. Since we've explained exactly what my 'disability' is, I won't be placed in a room with someone with a physical disability. I don't think they pair students up that way anyway. I'd like a roommate actually, but they think I should live in a single room so I'm really just going with the flow.