The only times I ever take anything is when travelling with the kids. Will occasionally grab fruit/ nuts/ rice crackers for them to eat on the plane.
In general I think there's a reasonably clear line between taking a piece of fruit or two and loading up a bag to take away but perhaps common...