My baby sleeps well in her crib but wakes when her pacifier falls out MANY times a night. Any ideas?

My 2 1/2 month old daughter has been sleeping in her crib for the last two weeks. Some nights she'll sleep 7 hours. Most nights she'll be doing great then that pacifier will fall out....I'll get up 10 or more times every night to put her paci back in her mouth, I'm exhausted then and end up putting her in the bed with me as my husband works nights. Any advice would be greatly appreciated.