Why do my hands get so cold they feel like theyre going to break off?

im in NYC and my family went to central park today. Nobody was cold, including me. But my hands were practically frozen and I was wearing two layers of gloves, the ones on top being made of leather. They ached, tingled, and stung like a mofo. It kind of ruined the experience for me & It took them a long time to defrost. Everyone called me a wuss, but I was in serious pain. Whats wrong with me?