I've had similar problems, though mostly when leaving home, and mostly when the flight is early. It gets less bad when I travel more frequently. I assume it's anxiety. I've found that, if it's not early, waiting to pack until the morning helps. (I know about how long I need.)