Your blurry images are either caused by motion blur or focus blur (too close to object) or both.
Anyway, I would suggest the Panasonic Lumix LX5
This a premium compact P&S camera, so it is small, light weight, easy to use and still inexpensive.
Reasons:
1. Macro mode with a minimum focus distance of 1cm (.4"), any closer and the camera's shadow will be in the way
2. Good low light capability (fast lens + low noise sensor) with good optical stabilization --> this will eliminate your motion blur
3. Focus speed and accuracy is higher than other typical P&S camera
4. Has an easy to use manual focus mode which include macro distances
5. Wide angle (24mm) lens gives expansive looking macro shots
6. Has RAW mode to allow better image post processing
7. Pocketable, easy to carry, light weight
You can find it at the below link.