What you can hope from it
I personally tried it on one of my working papers and was very much satisfied with the value for money/time.
If you are sharing the pages of your paper with the Mturker via a dropbox public folder, you might want to avoid manually copying the public links to each of your pages into the cvs file. If you are using a mac, one way to automate this step is using the Create Dropbox Collection v1.1 service by Brett Terpstra. However, this generates an ordered list of the links, meaning you will still have to manually remove the numbers in front of each link. If you want to skip that last step, see the simple tweak of Create Dropbox Collection I put on the Code section.