Hmm, there was a paper back in 2004ish about the Eunuch deer of Kodaik Island BC Canada. You might want to check it out. It seems to be similar to what you are saying. There was a whole subset of of a pop of male deer that didn't go into rut and were larger than than the norm.
Send me references
[email protected]