Is Celsus a Zeus mythicist, an Attis mythicist, an Osiris mythicist, etc, just as he is a Jesus mythicist?
The answer is: we don't know, because Celsus doesn't detail his own views clearly.
wrong. The answer is: we know that Celsus is not an atheist. We know that the true gods about which existence Celsus didn't doubt, that these gods didn't exist (and didn't work) on earth but only in heaven.
Nihil enim in speciem fallacius est quam prava religio. -Liv. xxxix. 16.