Fifth miniproject: "Corpus analysis: the web as a concordance"

One of the earliest functions of the internet, and in particular of the web, was as a text and data archive. From the scientific point of view, this is still the case, although other functions, such as advertising and e-commerce have gained enormously in importance.

An archive can be thought of as a database, and in the case of the web this database is very inhomogeneously structured. Unlike classical databases, therefore, which have fairly stereotyped query-response mechanisms, one of the main query-response mechanisms on the web is "full text search". For this purpose, "search engines" are used, which create indices of search keys based both on keywords in web documents, and in the text of web documents. These indices are also databases.

In many ways, the output of a search engine resembles the traditional linguistic "concordance".

The task set for this miniproject involves the following:

• What is a "concordance"?
• Find examples of concordances with paper layout.
• Find examples of concordances on the web.
• Test and describe a number of web concordances.
• Specify a web concordance as if you were going to construct one in cooperation a team of specialists.
• Formulate your results in a class presentation.

Please use the standard planning schema for this miniproject:

Requirements specification:

Design:

Implementation:

Distribution:

Evaluation: