Tips to Remember
Be judicious in the use of multiple word entities.
Make sure your examples are diverse.
Do not load up a lot of ambivalent examples at the outset.
Do not guess at annotation.
If practical, review complete documents if they contain new entity highlighting.
At a minimum, review 30 words before and after each highlighted entity.
Run through at least three rounds before relying on information retrieval measurements (recall, precision, F1).