fly-by-night

A person or business that appears and/or disappears rapidly, appearing untrustworthy, or giving an impression of transience.