The study of semiotics has now become a new methodology in language studies. Language works through relations of difference, which place signs in opposition to one another. Saussure asserted that there are only two types of relations: syntagmatic and paradigmatic. This paper first examines formulaic language through paradigmatic and syntagmatic analysis and then explores the usage-based nature of formulaic language under the cognitive view on language use. It shows that a multidimensional approach to the study of formulaic language has implications which, if taken seriously, could change our views of language use.