Moteur recherche web

Question

bonjour,
j'ai créer mon propre moteur de recherche sur le web mais je dois mettre dans mysql page par page ou y a un autre moyen ???

syndrael · Answer

Je te conseille PhpDig, assez simple à installer. Il y a aussi
MnoGoSeacrh mais là tu auras besoin d'un peu de Perl à mes bons
souvenirs..

S.

astuces_jeux · Answer

et on a sa ou ???

syndrael · Answer

Dans toutes les bonnes boucheries.. Google est ton ami --> PhpDig et hop..
www.framasoft.net/article2165.html
www.phpdig.net/
www.phpdig.net/francaise.php?action=doc
www.comscripts.com/scripts/php.phpdig.596.html

Tu en as besoin d'autres ???

S.

astuces_jeux · Answer

sa daccord mais sa marche comment PHPDig ??? en fait moi je me suis servi du code rottmanh's search ou un truc comme sa et sa est pret mais en fait y a pas un logiciel qui envoi toutes les pages vues sur la base de données ??? ou pour ajouter toutes les pages ??? pour mon moteur de recherche web mais si PHPDig fait ce que je demandes avec un autre moteur de recherche moi je veux bien !!!

syndrael · Answer

pourkoa faut-il ke la page soit vue pour être dans la base de données ? Es-tu sur de vouloir un moteur de recherche ? 

Le principe d'un moteur de recherche est lors de la CREATION de ta page
de l'indexer, ça veut dire ke ça la découpe en autant de mots qui
pourraient être demandés dans ton moteur.

Bonne chance.

S.

astuces_jeux · Answer

je ne comprend pas !! je doismettre les pages dedans comment ??

syndrael · Answer

Le plus simpe est ke tu installe PhpDig et tu verras l'interface
d'administration, là tu remarqueras une fonciton ki te permet d'indexer
tes pages à partir d'un emplacement de ton site..

Bonne chance.

S.

astuces_jeux · Answer

oui daccord mais je l'install puis dans _connect.php ou un truc comme sa (dans include) je met les infos de ma base puis je met sur internet par ftp, et je tape http://monsite/phpdig/admin/install.php et sa me met : Fatal error: Call to undefined function: mb_eregi() in /phpdig/includes/config.php on line 109 erreur a la ligne 109 qui est : if ((isset($ _SERVER['SCRIPT_FILENAME'])) && (mb_eregi("config.php",$ _SERVER['SCRIPT_FILENAME']))) { voici le code de config.php : 'and operator', 'w_whole' => 'exact phrase', 'w_part' => 'or operator' define('PHPDIG_LOGS',true); // write logs from searches for statistics define('LOG_CLICKS',true); // log clicks from searches for statistics define('NUMBER_OF_RESULTS_PER_SITE',-1); // max number of search results per site // use -1 to display all search results /***********************************************************************************************************************/ //--------LIST SETTINGS define('LIST_ENABLE',true); // activates/deactivates listing of past queries define('LIST_PAGE','list.php'); // the name of the list page define('LIST_NEW_WINDOW',1); // open queries in new window define('LIST_SHOW_ZEROS',0); // show queries with zero results define('LIST_DEFAULT_LIMIT',20); // listings per page - positive integer of ten - 10,20,30,... define('LIST_META_TAG',''); // meta tag for list page /***********************************************************************************************************************/ //--------INDEX SETTINGS define('TEXT_STORAGE_AMOUNT',10000); // max characters per page to store in files/tables define('TEXT_CONTENT_PATH','text_content/'); // path to text content files directory for indexed page content define('CONTENT_TEXT',0); // activates/deactivates the storage of text content in files define('SPIDER_MAX_LIMIT',20); // max (re)index search depth - used for shell and admin panel dropdown define('RESPIDER_LIMIT',5); // max update search depth - only used for browser, not used for shell define('LINKS_MAX_LIMIT',20); // max (re)index links per - used for shell and admin panel dropdown define('RELINKS_LIMIT',5); // max update links per - only used for browser, not used for shell define('LIMIT_TO_DIRECTORY',false); // limit index to given (sub)directory where (sub)directories of give (sub)directory are NOT indexed // for limit to directory, URL format must either have file at end or ending slash at end // e.g., http://www.domain.com/dirs/ (WITH ending slash) or http://www.domain.com/dirs/dirs/index.php define('ALLOW_SUBDIRECTORIES',false); // limit index to given (sub)directory where (sub)directories of give (sub)directory are indexed // if set to true, LIMIT_TO_DIRECTORY must also be set to true define('LIMIT_DAYS',0); // default days before reindexing a page via admin panel or shell is allowed // this does not automatically reindex - to auto reindex, you need to run a cron job define('SMALL_WORDS_SIZE',2); // min size of word to not index - must be two or more define('MAX_WORDS_SIZE',300); // max size of word to not index - words separated by spaces define('PHPDIG_EXCLUDE_COMMENT',''); // comment to exclude part of a page define('PHPDIG_INCLUDE_COMMENT',''); // comment to include part of a page // comments must be on their own lines in the HTML source // text within comments is not indexed // links within comments are indexed define('APPEND_TITLE_META',false); // append title and meta information to indexed results define('TITLE_WEIGHT',3); // relative title weight: APPEND_TITLE_META needs to be true define('PHPDIG_SESSID_REMOVE',true); // remove SIDs or variables from links being indexed define('PHPDIG_SESSID_VAR','PHPSESSID,s'); // name of SID or variable to remove - cAsE sEnSiTiVe // can be 's' or comma delimited 's,id,var,foo,etc' define('PHPDIG_DEFAULT_INDEX',false); // consider (index|default)\.(php|phtml|asp|htm|html)$ the same as / // e.g., http://www.domain.com/index.php same as http://www.domain.com/ define('PHPDIG_IN_DOMAIN',true); // jump hosts in the same domain // e.g., if the host is www.domain.com , the domain is domain.com define('SILENCE_404S',true); // silence 404 output when indexing define('TEMP_FILENAME_LENGTH',8); // filename length of temp files that are created when indexing // if using external tools with extension, use 4 for a filename of length 8 define("END_OF_LINE_MARKER"," "); // end of line marker - keep double quotes define('CHUNK_SIZE',1024); // pages are divided into chunks for processing // chunk size for regex processing define('USE_RENICE_COMMAND','1'); // use renice for process priority // see http://www.google.com/search?q=man+renice to learn about renice /***********************************************************************************************************************/ //---------EXTERNAL TOOLS SETUP define('USE_IS_EXECUTABLE_COMMAND','1'); // use PHP is_executable for external binaries // if set to true, is_executable used // set to '0' if is_executable is undefined // note: chances are that you do not need to set any options, as phpdig should use the 'DETECT_ORDER' constant for encoding // only set an extension if the external binary output is not STDOUT and a different extension is produced by the external binary // e.g., use '.txt' (including the period) if the external binary writes output to filename.txt instead of piping output to STDOUT define('PHPDIG_INDEX_MSWORD',false); // activate/deactivate define('PHPDIG_PARSE_MSWORD','/usr/local/bin/catdoc'); // full path to external binary define('PHPDIG_OPTION_MSWORD',''); // external binary options, e.g., '-s utf-8' define('PHPDIG_MSWORD_EXTENSION',''); // only set if NOT STDOUT define('PHPDIG_INDEX_PDF',false); // activate/deactivate define('PHPDIG_PARSE_PDF','/usr/local/bin/pdftotext'); // full path to external binary define('PHPDIG_OPTION_PDF',''); // external binary options, e.g., '-enc UTF-8' define('PHPDIG_PDF_EXTENSION','.txt'); // only set if NOT STDOUT define('PHPDIG_INDEX_MSEXCEL',false); // activate/deactivate define('PHPDIG_PARSE_MSEXCEL','/usr/local/bin/xls2csv'); // full path to external binary define('PHPDIG_OPTION_MSEXCEL',''); // external binary options, e.g., '-s utf-8' define('PHPDIG_MSEXCEL_EXTENSION',''); // only set if NOT STDOUT define('PHPDIG_INDEX_MSPOWERPOINT',false); // activate/deactivate define('PHPDIG_PARSE_MSPOWERPOINT','/usr/local/bin/ppt2text'); // full path to external binary define('PHPDIG_OPTION_MSPOWERPOINT',''); // external binary options, e.g., 'whatever' define('PHPDIG_MSPOWERPOINT_EXTENSION',''); // only set if NOT STDOUT /***********************************************************************************************************************/ //--------CRON SETTINGS // note: make sure ABSOLUTE_SCRIPT_PATH is the full path up to but not including the admin dir, no ending slash // note: CRON_ENABLE set to true writes a file at CRON_CONFIG_FILE containing the cron job information // the CRON_CONFIG_FILE must be 777 permissions if applicable to your OS/setup. // you still need to call the CRON_CONFIG_FILE to run the cron job !!! // from shell: crontab CRON_CONFIG_FILE to set the cron job: replace CRON_CONFIG_FILE with actual file // from shell: crontab -l to list and crontab -d to delete define('CRON_ENABLE',false); // activates/deactivates creation of cron file define('CRON_EXEC_FILE','/usr/bin/crontab'); // full path to crontab define('CRON_CONFIG_FILE',ABSOLUTE_SCRIPT_PATH.'/admin/temp/cronfile.txt'); // where to write cron file define('PHPEXEC','/usr/local/bin/php'); // full path to PHP /***********************************************************************************************************************/ //---------FTP SETTINGS define('FTP_ENABLE',0); // activate/deactivate ftp for distant indexing define('FTP_HOST',''); // if distant indexing, set the ftp host define('FTP_PORT',21); // if distant indexing, set the ftp port define('FTP_PASV',1); // activates/deactivates passive mode define('FTP_PATH',''); // distant path from the ftp root define('FTP_TEXT_PATH','text_content'); // ftp path to the text content directory define('FTP_USER',''); // ftp username define('FTP_PASS',''); // ftp password /***********************************************************************************************************************/ //---------RSS SETTINGS define('ALLOW_RSS_FEED',false); // activate/deactivate feed - if true, set rss directory to 777 permissions if applicable $theenc = PHPDIG_ENCODING; // needs to be same encoding used in index - do not change !!! $theurl = " http://www.phpdig.net/ "; // site offering the rss feed $thetitle = "PhpDig.net"; // title for site offering the rss feed $thedesc = "PhpDig :: Web Spider and Search Engine"; // description of site offering the rss feed $thedir = "./rss"; // the rss directory name, no ending slash $thefile = "search.rss"; // value used in rss filenames /***********************************************************************************************************************/ //--------FORBIDDEN SETTING // regexp for forbidden links - some links may return text/html mime-type but should not be indexed so forbid them !!! // you can also expand the FORBIDDEN value by writing a regex to forbid certain links containing 'word' from being indexed define('FORBIDDEN','\.(js|inc|rm|ico|cab|swf|css|gz|z|tar|zip|tgz|msi|arj|zoo|rar|r[0-9]+|exe|bin|pkg|rpm|deb|bz2)$'); /***********************************************************************************************************************/ //----------CHARACTER CLASS CONTAINING CHARACTERS ALLOWED IN LINKS // character class MUST have "[ characters go in here ]*" format // do NOT enter [ or ] in character class - blackslash other special characters // see http://www.php.net/manual/en/reference.pcre.pattern.syntax.php for further info // $allowed_link_chars = "[:%/?=&;\,._a-zA-Z0-9|+ ()~-]*"; // includes space and () but not good with javascript $allowed_link_chars = "[:%/?=&;\,._a-zA-Z0-9|+~-]*"; /***********************************************************************************************************************/ //----------MONTH NAMES // month names in iso dates $month_names = array ('jan'=>1, 'feb'=>2, 'mar'=>3, 'apr'=>4, 'may'=>5, 'jun'=>6, 'jul'=>7, 'aug'=>8, 'sep'=>9, 'oct'=>10, 'nov'=>11, 'dec'=>12 ); /***********************************************************************************************************************/ //----------APACHE INDEX PAGES // apache fancy indexing queries to not follow $apache_indexes = array ( "?N=A" => 1, "?N=D" => 1, "?M=A" => 1, "?M=D" => 1, "?S=A" => 1, "?S=D" => 1, "?D=A" => 1, "?D=D" => 1, "?C=N&O=A" => 1, "?C=M&O=A" => 1, "?C=S&O=A" => 1, "?C=D&O=A" => 1, "?C=N&O=D" => 1, "?C=M&O=D" => 1, "?C=S&O=D" => 1, "?C=D&O=D" => 1); /***********************************************************************************************************************/ //----------NOTHING TO CHANGE BELOW THIS LINE // check to make sure a language is set if (!isset($phpdig_language)) { $phpdig_language = "en"; } // include a language file define('PHPDIG_LANG_CONSTANT',$phpdig_language); // this line is needed for classic if (is_file("$relative_script_path/locales/$phpdig_language-language.php")) { include "$relative_script_path/locales/$phpdig_language-language.php"; } elseif (is_file("$relative_script_path/locales/en-language.php")) { include "$relative_script_path/locales/en-language.php"; } else { die("Unable to select language pack. "); } // connect to database if ((!isset($no_connect)) || ($no_connect != 1)) { if (is_file("$relative_script_path/includes/connect.php")) { include "$relative_script_path/includes/connect.php"; } else { die("Unable to find connect.php file. "); } } // include the libraries if (is_file("$relative_script_path/libs/phpdig_functions.php")) { include "$relative_script_path/libs/phpdig_functions.php"; } else { die ("Unable to find phpdig_functions.php file. "); } if (is_file("$relative_script_path/libs/function_phpdig_form.php")) { include "$relative_script_path/libs/function_phpdig_form.php"; } else { die ("Unable to find function_phpdig_form.php file. "); } if (is_file("$relative_script_path/libs/mysql_functions.php")) { include "$relative_script_path/libs/mysql_functions.php"; } else { die ("Unable to find mysql_functions.php file. "); } // check the template value if ((!isset($template)) || ((!is_file($template)) && ($template != "array") && ($template != "classic"))) { die ("Unable to render template file. "); } // send encoding if needed if (!headers_sent()) { header('Content-type:text/html; Charset='.PHPDIG_ENCODING); } // turn off magic_quotes_runtime for escaping purposes @ini_set('magic_quotes_runtime',false); // turn off magic_quotes_sybase for escaping purposes @ini_set('magic_quotes_sybase',false); // check that the tables exist if ((!isset($no_connect)) || ($no_connect != 1)) { phpdigCheckTables($id_connect,array('engine', 'excludes', 'keywords', 'sites', 'spider', 'tempspider', 'logs', 'clicks', 'site_page', 'includes')); } ?> on peut maider ???

Moteur recherche web

8 réponses

Votre réponse

Discussions similaires