Taha 20:16

Fala yasuddannaka AAanhaman la yu/minu biha wattabaAAa hawahufatarda

So do not let one avert you from it who does not believe in it and follows his desire, for you [then] would perish.

So the one who does not believe in it and follows his desires must not make you neglectful of it, otherwise you will perish.