to exit a place without making noise or drawing attention.

静かに去る

to withdraw from a situation or relationship without causing a scene or conflict.

波風を立てずに去る