have nothing to do with sb/sth

to not be involved in something or to refuse to have a relationship with someone.