can’t afford to do sth

you use this when you must not do something because it would cause serious problems or bad results.