I think it all depends on the setting.
If you're out, with jeans, nice shoes, nice button down (tucked in) shirt, with blazer, it's okay to have it unbuttoned. You could wear that to the beach, out to a nice lounge/club (something like Pure or Light, but most definitely not S4.)
If you're at a corporate dinner, nice shoes, slacks, button down shirt (tucked in, again), the blazer needs to be buttoned, until you sit down. Then it's acceptable to unbutton it.
"A girl like me lands on her feet."