Women in Technology

Giff is probably writing for Google by now, but maybe this will help someone else. This is actually not as tough as it might appear. First, add an extra field to the pages table -call it page_text, and make it the text datatype so that it's not constrained size-wise. Next, in your spider, insert an extra line as follows:

/* Try to remove all HTML-tags: */

   $buf = strip_tags($buf);

   $buf = ereg_replace('/&\w;/', '', $buf);

   /* the above is for context, here's the new stuff: */

   mysql_query("UPDATE page SET page_text = '$buf' WHERE page_id = $page_id");

The only other thing is to add code that checks for the exact search phrase to the search engine portion of the project. The simplest way to write an exact phrase match search (and this will only find exact matches) would be to replace the search query with something like this:

SELECT p.page_url AS url

FROM page p 

WHERE page_text LIKE '%$keyword%'

Hope this helps!

--Rich