My high heeled pumps are the right size, but my heel comes out of the shoe every time i take a step?

i got a pair of pumps for my sisters wedding and they are the correct size, but every time i take a step my heel comes out of the shoe. how can i prevent this or what can i put in my shoe to keep my foot inside? thanks for your help! really appreciate it!