Genesis 49:26 :
So the simple fact that Jesus is 'from Nazaret' implies not only that Jesus has to be called 'Nazarene', but also that the he has to have Brothers there and he has to be 'set apart from his brothers'. So it is implicit in nuce the negation of a carnal brotherhood just when it is claimed.
Now, it would be not a coincidence that the Brothers of the Patriarch Joseph bear quasi the same names of the Brothers of Jesus listed by who knew them precisely…. ...in Nazaret !
Genesis 49:16 gives not only Brothers to Jesus as Nazarene, but also an earthly father named Joseph, as the patriarch who receives the blessing in Gen 49:16.