hang back from

to stay behind or move more slowly than others because you are nervous or want to wait.