while wee usually means small it is used in the this context to indicate young man - often used by fathers to refer to their sons. On the other hand, In the name o' the wee man is a mild expletive!
WEE MAN
Meaning of WEE MAN in English
Scottish slang English vocabulary. Английский словарь шотландского сленга. 2012