Most people take the stem and try to pull it back. You often need to use a knife or a fingernail to cut through the skin. If your nails are short and nothing sharp is around, it can be a fight that ends up with a big chunck of mashed or bruised banana.
Turn that banana upside right. Yes, that is what I said. Have you watched a monkey eat a banana? The stem is a handle. Slightly pinch the base, it quickly splits apart and you can peel the banana. I make sure the very tip of banana pulls back with the peel. The peel will naturally peel back in sections easier than from the other direction.
Don't knock it until you've tried it.