Annotation (especially multimedia annotations) as a scaffolding of the second language vocabulary learning, its effect on learning has been paid more and more attention by researchers. The theoretical foundation which the annotation effects the second language vocabulary learning has been reviewed from the perspective of cognitive psychology. The framework of interpretation relating to the research has been presented. This article reviews the existing research about three types on second language vocabulary learning effect, which includes annotation forms(single mode / multi mode, single definition / multiple choice), annotation language(mother tongue / second language) and annotation location(at the bottom of the page / margin / following the word etc). It summaries the conclusions, divergences and limitations of existing researches, and except to lay a foundation for developing the further study about second language vocabulary learning with technology.