take one's leave

The Black vernacular phrase from which “You Don’t Have to Tell Me Twice” takes its name is a verb, he says — an assertion of the right to take one’s leave from participation in your own oppression.

“You know that it is bad form to take one’s leave without saying ‘adieu,’ and believe me,” and he again laughed, “I thank you for your lavish reception in honor of the fake lord.”

What was there to do on a last day but look and note, and watch, and take one's leave?