Mon 15 Dec, 2008
Effective Information Retrieval using Genetic Algorithms based Matching Functions
Comments (0) Filed under: Artificial IntelegenceTags: Artificial Intelegence, Genetic Algorithms, Information Retrieval, Matching Functions, Michael Gordon, Praveen Pathak, Weiguo Fan
Author:Praveen Pathak, Michael Gordon, Weiguo Fan
Description:
Knowledge intensive organizations have vast array of information contained in large document repositories. With the advent of E-commerce and corporate intranets/extranets, these repositories are expected to grow at a fast pace. This explosive growth has led to huge, fragmented, and unstructured document collections. Although it has become easier to collect and store information in document collections, it has become increasingly difficult to retrieve relevant information from these large document collections. This paper addresses the issue of improving retrieval performance (in terms of precision and recall) for retrieval from document collections.There are three important paradigms of research in the area of information retrieval (IR): Probabilistic IR, Knowledge-based IR, and, Artificial Intelligence based techniques like neural networks and symbolic learning. Very few researchers have tried to use evolutionary algorithms like genetic algorithms (GA’s). Previous attempts at using GA’s have concentrated on modifying document representations or modifying query representations. This work looks at the possibility of applying GA’s to dapt various matching functions. It is hoped that such an adaptation of the matching functions will lead to a better retrieval performance than that obtained by using a single matching function. An overall matching function is treated as a weighted combination of scores produced by individual matching functions. This overall score is used to rank and retrieve documents. Weights associated with individual functions are searched using Genetic Algorithm.