查找超过 10MB 的文件
find . -type f -size +10000k -exec ls -lh {} \; | awk ‘{ print $9 “: ” $5 }’
搜索
MySQL+ sphinx + 中文分词+Sphinx4phpBB – phpBB 论坛全文搜索解决方案
由于MySQL的全文搜索的局限，phpBB论坛的搜索功能一直以来就不是很完善。英文论坛可以采用sphinx全文搜索引擎解决，中文论坛就很头疼，只能用二分法分词。终于给我找到Coreseek.cn 提供的基于sphinx的开源中文分词解决方案，完美解决了phpBB的中文搜索。
下面就详细说明在phpbb上的具体安装、实现，包括了网上找到的资料以及我做的一些小修改，希望对大家有用。在实现过程中，我也碰到很多问题，Google下基本都能找到答案，多用搜索功能吧
环境: MySQL 5.1.42 + phpBB 3.0.6 + Coreseek Fulltext Server 3.1-rc1 (基于Sphinx 0.9.9-rc1 )
安装 Coreseek Mmseg
源代码下载：http://www.coreseek.cn/products/ft_down/
目前我用的版本为：Coreseek Mmseg(源代码) 3.1
目前我用的版本为：Coreseek Mmseg(源代码) 3.1
# tar -zxvf mmseg-3.1.tar.gz
# cd mmseg-3.1
# ./configure –prefix=/usr/local/mmseg
# make
# make install
# cd ..
安装mmseg完成,测试一下：# mmseg
有问题可以尝试执行下面的命令
# echo ‘/usr/local/mmseg/lib’ >> /etc/ld.so.conf
# ldconfig -v
# ln -s /usr/local/mmseg/bin/mmseg /bin/mmseg
重新编译mysql以支持sphinxSE
首先需要重新编译mysql以支持sphinxSE （mysql插件方式的sphinx）
下载MySQL源码，需要5.1以上版本，且与服务器上已安装的版本一致: http://www.mysql.com
我下载的是：MySQL-community-5.1.42-0.rhel5.src.rpm，然后解压：
# rpm2cpio MySQL-community-5.1.42-0.rhel5.src.rpm | cpio -idmv
# tar -xzvf mysql-5.1.42.tar.gz
下载Coreseek Fulltext Server 源代码，就是包含了中文补丁的Sphinx：http://www.coreseek.cn/products/ft_down/
然后解压：
# tar -xzvf csft-3.1.tar.gz
停止Mysql服务：/etc/rc.d/init.d/mysqld stop
接着将sphinx下的mysqlse 文件夹下的数据拷贝到 mysql-5.1.42/storage/sphinx 下面
(这样才能在编译 mysql的时候把SphinxSE存储引擎编译进去)
只要make，不要install
# cp -rf csft-3.1/mysqlse mysql-5.1.42/storage/sphinx
# cd mysql-5.1.42
#
# make clean
# sh BUILD/autorun.sh
# ./configure
# make
将插件复制到mysql插件目录：(每台服务器的路径不一样)
# mkdir /usr/lib/mysql/plugins
# cp storage/sphinx/.libs/ha_sphinx.* /usr/lib/mysql/plugins
修改mysql配置文件my.cnf，加上：
plugin_dir=/usr/lib/mysql/plugins
编译完成，启动mysql，安装插件并检查SphinxSE存储引擎是否编译进去
# /etc/rc.d/init.d/mysqld start
# mysql -uroot -p
Mysql> INSTALL PLUGIN sphinx SONAME ‘ha_sphinx.so’;
Mysql> show engines;
此时我们可以看到已经包含sphinxSE 引擎:
| CSV | YES | CSV storage engine
…..
| SPHINX | YES |
Sphinx storage engine 0.9.9
安装中文版sphinx(Coreseek全文搜索服务器)
安装中文版sphinx (Coreseek 的全文搜索服务器)
# tar -xzvf csft-3.1.tar.gz
# cd csft-3.1
# ./configure
–prefix=/usr/local/sphinx –with-mysql=/usr/
–with-mysql-includes=/usr/include/mysql
–with-mysql-libs=/usr/lib/mysql
–with-mmseg-includes=/usr/local/mmseg/include/mmseg
–with-mmseg-libs=/usr/local/mmseg/lib –with-mmseg
coreseek安装的时候会出现一些问题，我没有选择python支持。
下面列出一些我遇到的问题和解决方法：
出现错误：
undefined reference to `libiconv_open’
undefined reference to `libiconv_close’
官网解决办法：
修改configure 文件把 #define USE_LIBICONV 0 最后的数值由1改为0
vi configure
输入/define USE_LIBICONV 找到目标行，按i键后将1改成0, 按esc, 输入:wq保存退出
vi ./src/sphinx.cpp
注释以下代码
// case TOKENIZER_ZHCN_GBK:
// pTokenizer = sphCreateGBKChineseTokenizer
// (tSettings.m_sDictPath.cstr(), tSettings.m_nBest); break;
然后重新编译
# make clean
# make
# make install
这样的方法，把GBK的支持去掉了，只能用UTF8。
有人说比较完美的解决方法是：
vi /src/Makefile
将 LIBS = -lm -lz -lexpat -L/usr/local/lib -lpthread
改为 LIBS = -lm -lz -lexpat – liconv -L/usr/local/lib -lpthread
我试过有些问题，好在我不需要gbk，就用前一种方法了。
再把根目录下Makefile也这样改一下。要在configure之后改，然后make。
复制一份sphinx的配置
1. cd /usr/local/sphinx/etc
2. cp sphinx.conf.dist csft.conf
配置、测试 sphinx (可选操作)
由于后面使用的phpbb的sphinx插件，会自动配置sphinx环境，所以本贴操作为可选项。仅
用于自己测试sphinx的安装是否正确。sphinx 的各参数说明在软件包的doc目录下
用于自己测试sphinx的安装是否正确。sphinx 的各参数说明在软件包的doc目录下
1. 配置sphinx
修改/usr/local/sphinx/etc /csft.conf （英文版用的配置文件是sphinx.conf）
1. type = mysql
2. # some straightforward parameters for SQL source types
3. sql_host = localhost
4. sql_user = root
5. sql_pass =
6. sql_db = test
7. sql_port = 3306 # optional, default is 3306
8.
9. address = 127.0.0.1 # 安全点可以只监听本机
2. 建立 sphinx 索引
装好 sphinx后在sphinx的目录中有三个目录 分别为bin etc var
bin中存有sphinx用到的一些执行文件，包括：
indexer 索引建立
search 查询工具
searchd 查询服务器
索引的建立方法为
/usr/local/sphinx/bin/indexer
–config /home/sphinx_config/csft.conf your_database
3. 查询服务器
开启：
/usr/local/sphinx/bin/searchd –config
/usr/local/sphinx/etc/csft.conf
关闭：
/usr/local/sphinx/bin/searchd
–config /usr/local/sphinx/etc/csft.conf –stop
sphinx的查询，可以大致分为三种
1. 数据库引擎中的查询
2. 通过search工具查询
/usr/local/sphinx/bin/search
–config /usr/local/sphinx/etc/csft.conf test
给sphinx 加上中文分词
给 sphinx 加上中文分词1. 生成词典
进入到mmseg的源代码目录
1. cd data
2. mmseg -u unigram.txt
在data下边会产生一个文件 unigram.txt.uni
这个就是生成的字典 然后把字典改名为uni.lib，放在可以读取的目录中即可
# cp unigram.txt.uni /usr/local/sphinx/uni.lib
2. 修改配置文件，在索引中加入：（本步骤可以跳过，在下个贴子中附上的插件的代码中已做了修改，因为插件会自动更新sphinx的配置文件）
1. charset_type = zh_cn.utf-8
2. charset_dictpath = /usr/local/sphinx/
3. sql_query_pre = SET NAMES utf8
phpbb 插件：Sphinx4phpBB
安装phpbb插件：Sphinx4phpBB目前最新的版本rev.48可以通过 svn checkout http://code.phpbb.com/svn/sphinx/trunk/ 获得
后台设置
1. 设置参数：综合 -> 服务器配置 -> 搜索设定，设置sphinx插件的各参数
2. 激活插件：综合 -> 服务器配置 -> 搜索设定，搜索后端 = Fulltext sphinx
3. 创建索引：维护 -> 数据库 -> 搜索索引 -> Fulltext sphinx -> 创建索引
插件中的 \includes\search\fulltext_sphinx.php 需要修改，从而支持中文版sphinix。
代码如下：
<?php
/**
*
* @package search
* @version $Id: fulltext_sphinx.php 48 2009-08-31 10:28:43Z acydburn $
* @copyright (c) 2005 phpBB Group
* @license http://opensource.org/licenses/gpl-license.php GNU Public License
*
*/
/**
*/
if (!defined('IN_PHPBB'))
{
exit;
}
/**
* @ignore
*/
require($phpbb_root_path . "includes/sphinxapi-0.9.8." . $phpEx);
define('INDEXER_NAME', 'indexer');
define('SEARCHD_NAME', 'searchd');
define('SPHINX_TABLE', table_prefix() . 'sphinx');
define('MAX_MATCHES', 20000);
define('CONNECT_RETRIES', 3);
define('CONNECT_WAIT_TIME', 300);
/**
* Returns the global table prefix
* This function is necessary as this file is sometimes included from within a
* function and table_prefix is in global space.
*/
function table_prefix()
{
global $table_prefix;
return $table_prefix;
}
/**
* fulltext_sphinx
* Fulltext search based on the sphinx search deamon
* @package search
*/
class fulltext_sphinx
{
var $stats = array();
var $word_length = array();
var $split_words = array();
var $search_query;
var $common_words = array();
var $id;
function fulltext_sphinx(&$error)
{
global $config;
$this->id = $config['avatar_salt'];
$this->indexes = 'index_phpbb_' . $this->id . '_delta;index_phpbb_' . $this->id . '_main';
$this->sphinx = new SphinxClient ();
if (!empty($config['fulltext_sphinx_configured']))
{
if ($config['fulltext_sphinx_autorun'] && !file_exists($config['fulltext_sphinx_data_path'] . 'searchd.pid') && $this->index_created(true))
{
$this->shutdown_searchd();
// $cwd = getcwd();
// chdir($config['fulltext_sphinx_bin_path']);
exec($config['fulltext_sphinx_bin_path'] . SEARCHD_NAME . ' --config ' . $config['fulltext_sphinx_config_path'] . 'sphinx.conf >> ' . $config['fulltext_sphinx_data_path'] . 'log/searchd-startup.log 2>&1 &');
// chdir($cwd);
}
// we only support localhost for now
$this->sphinx->SetServer('localhost', (isset($config['fulltext_sphinx_port']) && $config['fulltext_sphinx_port']) ? (int) $config['fulltext_sphinx_port'] : 3312);
}
$config['fulltext_sphinx_min_word_len'] = 1;
$config['fulltext_sphinx_max_word_len'] = 400;
$error = false;
}
/**
* Checks permissions and paths, if everything is correct it generates the config file
*/
function init()
{
global $db, $user, $config;
if ($db->sql_layer != 'mysql' && $db->sql_layer != 'mysql4' && $db->sql_layer != 'mysqli')
{
return $user->lang['FULLTEXT_SPHINX_WRONG_DATABASE'];
}
if ($error = $this->config_updated())
{
return $error;
}
// move delta to main index each hour
set_config('search_gc', 3600);
return false;
}
function config_updated()
{
global $db, $user, $config, $phpbb_root_path, $phpEx;
if ($config['fulltext_sphinx_autoconf'])
{
$paths = array('fulltext_sphinx_bin_path', 'fulltext_sphinx_config_path', 'fulltext_sphinx_data_path');
// check for completeness and add trailing slash if it's not present
foreach ($paths as $path)
{
if (empty($config[$path]))
{
return $user->lang['FULLTEXT_SPHINX_UNCONFIGURED'];
}
if ($config[$path] && substr($config[$path], -1) != '/')
{
set_config($path, $config[$path] . '/');
}
}
}
$executables = array(
$config['fulltext_sphinx_bin_path'] . INDEXER_NAME,
$config['fulltext_sphinx_bin_path'] . SEARCHD_NAME,
);
if ($config['fulltext_sphinx_autorun'])
{
foreach ($executables as $executable)
{
if (!file_exists($executable))
{
return sprintf($user->lang['FULLTEXT_SPHINX_FILE_NOT_FOUND'], $executable);
}
if (!function_exists('exec'))
{
return $user->lang['FULLTEXT_SPHINX_REQUIRES_EXEC'];
}
$output = array();
@exec($executable, $output);
$output = implode("\n", $output);
if (strpos($output, 'Coreseek ') === false)
{
return sprintf($user->lang['FULLTEXT_SPHINX_FILE_NOT_EXECUTABLE'], $executable);
}
}
}
$writable_paths = array(
$config['fulltext_sphinx_config_path'] => array('config' => 'fulltext_sphinx_autoconf', 'subdir' => false),
$config['fulltext_sphinx_data_path'] => array('config' => 'fulltext_sphinx_autorun', 'subdir' => 'log'),
$config['fulltext_sphinx_data_path'] . 'log/' => array('config' => 'fulltext_sphinx_autorun', 'subdir' => false),
);
foreach ($writable_paths as $path => $info)
{
if ($config[$info['config']])
{
// make sure directory exists
// if we could drop the @ here and figure out whether the file really
// doesn't exist or whether open_basedir is in effect, would be nice
if (!@file_exists($path))
{
return sprintf($user->lang['FULLTEXT_SPHINX_DIRECTORY_NOT_FOUND'], $path);
}
// now check if it is writable by storing a simple file
$filename = $path . 'write_test';
$fp = @fopen($filename, 'wb');
if ($fp === false)
{
return sprintf($user->lang['FULLTEXT_SPHINX_FILE_NOT_WRITABLE'], $filename);
}
@fclose($fp);
@unlink($filename);
if ($info['subdir'] !== false)
{
if (!is_dir($path . $info['subdir']))
{
mkdir($path . $info['subdir']);
}
}
}
}
if ($config['fulltext_sphinx_autoconf'])
{
include ($phpbb_root_path . 'config.' . $phpEx);
// now that we're sure everything was entered correctly, generate a config for the index
// we misuse the avatar_salt for this, as it should be unique ;-)
if (!class_exists('sphinx_config'))
{
include($phpbb_root_path . 'includes/functions_sphinx.php');
}
if (!file_exists($config['fulltext_sphinx_config_path'] . 'sphinx.conf'))
{
$filename = $config['fulltext_sphinx_config_path'] . 'sphinx.conf';
$fp = @fopen($filename, 'wb');
if ($fp === false)
{
return sprintf($user->lang['FULLTEXT_SPHINX_FILE_NOT_WRITABLE'], $filename);
}
@fclose($fp);
}
$config_object = new sphinx_config($config['fulltext_sphinx_config_path'] . 'sphinx.conf');
$config_data = array(
"source source_phpbb_{$this->id}_main" => array(
array('type', 'mysql'),
array('sql_host', $dbhost),
array('sql_user', $dbuser),
array('sql_pass', $dbpasswd),
array('sql_db', $dbname),
array('sql_port', $dbport),
array('sql_query_pre', 'SET NAMES utf8'),
array('sql_query_pre', 'REPLACE INTO ' . SPHINX_TABLE . ' SELECT 1, MAX(post_id) FROM ' . POSTS_TABLE . ''),
array('sql_query_range', 'SELECT MIN(post_id), MAX(post_id) FROM ' . POSTS_TABLE . ''),
array('sql_range_step', '5000'),
array('sql_query', 'SELECT
p.post_id AS id,
p.forum_id,
p.topic_id,
p.poster_id,
IF(p.post_id = t.topic_first_post_id, 1, 0) as topic_first_post,
p.post_time,
p.post_subject,
p.post_subject as title,
p.post_text as data,
t.topic_last_post_time,
0 as deleted
FROM ' . POSTS_TABLE . ' p, ' . TOPICS_TABLE . ' t
WHERE
p.topic_id = t.topic_id
AND p.post_id >= $start AND p.post_id <= $end'),
array('sql_query_post', ''),
array('sql_query_post_index', 'REPLACE INTO ' . SPHINX_TABLE . ' ( counter_id, max_doc_id ) VALUES ( 1, $maxid )'),
array('sql_query_info', 'SELECT * FROM ' . POSTS_TABLE . ' WHERE post_id = $id'),
array('sql_attr_uint', 'forum_id'),
array('sql_attr_uint', 'topic_id'),
array('sql_attr_uint', 'poster_id'),
array('sql_attr_bool', 'topic_first_post'),
array('sql_attr_bool', 'deleted'),
array('sql_attr_timestamp' , 'post_time'),
array('sql_attr_timestamp' , 'topic_last_post_time'),
array('sql_attr_str2ordinal', 'post_subject'),
),
"source source_phpbb_{$this->id}_delta : source_phpbb_{$this->id}_main" => array(
array('sql_query_pre', 'SET NAMES utf8'),
array('sql_query_range', ''),
array('sql_range_step', ''),
array('sql_query', 'SELECT
p.post_id AS id,
p.forum_id,
p.topic_id,
p.poster_id,
IF(p.post_id = t.topic_first_post_id, 1, 0) as topic_first_post,
p.post_time,
p.post_subject,
p.post_subject as title,
p.post_text as data,
t.topic_last_post_time,
0 as deleted
FROM ' . POSTS_TABLE . ' p, ' . TOPICS_TABLE . ' t
WHERE
p.topic_id = t.topic_id
AND p.post_id >= ( SELECT max_doc_id FROM ' . SPHINX_TABLE . ' WHERE counter_id=1 )'),
),
"index index_phpbb_{$this->id}_main" => array(
array('path', $config['fulltext_sphinx_data_path'] . "index_phpbb_{$this->id}_main"),
array('source', "source_phpbb_{$this->id}_main"),
array('docinfo', 'extern'),
array('morphology', 'none'),
array('stopwords', (file_exists($config['fulltext_sphinx_config_path'] . 'sphinx_stopwords.txt') && $config['fulltext_sphinx_stopwords']) ? $config['fulltext_sphinx_config_path'] . 'sphinx_stopwords.txt' : ''),
array('min_word_len', '1'),
array('charset_type', 'zh_cn.utf-8'),
array('charset_dictpath', '/usr/local/sphinx/'),
array('charset_table', 'U+FF10..U+FF19->0..9, 0..9, U+FF41..U+FF5A->a..z, U+FF21..U+FF3A->a..z, A..Z->a..z, a..z, U+0149, U+017F, U+0138, U+00DF, U+00FF, U+00C0..U+00D6->U+00E0..U+00F6, U+00E0..U+00F6, U+00D8..U+00DE->U+00F8..U+00FE, U+00F8..U+00FE, U+0100->U+0101, U+0101, U+0102->U+0103, U+0103, U+0104->U+0105, U+0105, U+0106->U+0107, U+0107, U+0108->U+0109, U+0109, U+010A->U+010B, U+010B, U+010C->U+010D, U+010D, U+010E->U+010F, U+010F, U+0110->U+0111, U+0111, U+0112->U+0113, U+0113, U+0114->U+0115, U+0115, U+0116->U+0117, U+0117, U+0118->U+0119, U+0119, U+011A->U+011B, U+011B, U+011C->U+011D, U+011D, U+011E->U+011F, U+011F, U+0130->U+0131, U+0131, U+0132->U+0133, U+0133, U+0134->U+0135, U+0135, U+0136->U+0137, U+0137, U+0139->U+013A, U+013A, U+013B->U+013C, U+013C, U+013D->U+013E, U+013E, U+013F->U+0140, U+0140, U+0141->U+0142, U+0142, U+0143->U+0144, U+0144, U+0145->U+0146, U+0146, U+0147->U+0148, U+0148, U+014A->U+014B, U+014B, U+014C->U+014D, U+014D, U+014E->U+014F, U+014F, U+0150->U+0151, U+0151, U+0152->U+0153, U+0153, U+0154->U+0155, U+0155, U+0156->U+0157, U+0157, U+0158->U+0159, U+0159, U+015A->U+015B, U+015B, U+015C->U+015D, U+015D, U+015E->U+015F, U+015F, U+0160->U+0161, U+0161, U+0162->U+0163, U+0163, U+0164->U+0165, U+0165, U+0166->U+0167, U+0167, U+0168->U+0169, U+0169, U+016A->U+016B, U+016B, U+016C->U+016D, U+016D, U+016E->U+016F, U+016F, U+0170->U+0171, U+0171, U+0172->U+0173, U+0173, U+0174->U+0175, U+0175, U+0176->U+0177, U+0177, U+0178->U+00FF, U+00FF, U+0179->U+017A, U+017A, U+017B->U+017C, U+017C, U+017D->U+017E, U+017E, U+4E00..U+9FFF'),
array('min_prefix_len', '0'),
array('min_infix_len', '0'),
),
"index index_phpbb_{$this->id}_delta : index_phpbb_{$this->id}_main" => array(
array('path', $config['fulltext_sphinx_data_path'] . "index_phpbb_{$this->id}_delta"),
array('source', "source_phpbb_{$this->id}_delta"),
),
'indexer' => array(
array('mem_limit', $config['fulltext_sphinx_indexer_mem_limit'] . 'M'),
),
'searchd' => array(
array('listen' , '127.0.0.1'),
// array('port', ($config['fulltext_sphinx_port']) ? $config['fulltext_sphinx_port'] : '3312'),
array('log', $config['fulltext_sphinx_data_path'] . "log/searchd.log"),
array('query_log', $config['fulltext_sphinx_data_path'] . "log/sphinx-query.log"),
array('read_timeout', '5'),
array('max_children', '30'),
array('pid_file', $config['fulltext_sphinx_data_path'] . "searchd.pid"),
array('max_matches', (string) MAX_MATCHES),
),
);
$non_unique = array('sql_query_pre' => true, 'sql_attr_uint' => true, 'sql_attr_timestamp' => true, 'sql_attr_str2ordinal' => true, 'sql_attr_bool' => true);
$delete = array('sql_group_column' => true, 'sql_date_column' => true, 'sql_str2ordinal_column' => true);
foreach ($config_data as $section_name => $section_data)
{
$section = &$config_object->get_section_by_name($section_name);
if (!$section)
{
$section = &$config_object->add_section($section_name);
}
foreach ($delete as $key => $void)
{
$section->delete_variables_by_name($key);
}
foreach ($non_unique as $key => $void)
{
$section->delete_variables_by_name($key);
}
foreach ($section_data as $entry)
{
$key = $entry[0];
$value = $entry[1];
if (!isset($non_unique[$key]))
{
$variable = &$section->get_variable_by_name($key);
if (!$variable)
{
$variable = &$section->create_variable($key, $value);
}
else
{
$variable->set_value($value);
}
}
else
{
$variable = &$section->create_variable($key, $value);
}
}
}
$config_object->write($config['fulltext_sphinx_config_path'] . 'sphinx.conf');
}
set_config('fulltext_sphinx_configured', '1');
$this->shutdown_searchd();
$this->tidy();
return false;
}
/**
* Splits keywords entered by a user into an array of words stored in $this->split_words
* Stores the tidied search query in $this->search_query
*
* @param string $keywords Contains the keyword as entered by the user
* @param string $terms is either 'all' or 'any'
* @return false if no valid keywords were found and otherwise true
*/
function split_keywords(&$keywords, $terms)
{
global $config;
if ($terms == 'all')
{
$match = array('#\sand\s#i', '#\sor\s#i', '#\snot\s#i', '#\+#', '#-#', '#\|#', '#@#');
$replace = array(' & ', ' | ', ' - ', ' +', ' -', ' |', '');
$replacements = 0;
$keywords = preg_replace($match, $replace, $keywords);
$this->sphinx->SetMatchMode(SPH_MATCH_EXTENDED);
}
else
{
$this->sphinx->SetMatchMode(SPH_MATCH_ANY);
}
$match = array();
// Keep quotes
$match[] = "#"#";
// KeepNew lines
$match[] = "#[\n]+#";
$replace = array('"', " ");
$keywords = str_replace(array('"', "\n"), array('"', ' '), trim($keywords));
if (strlen($keywords) > 0)
{
$this->search_query = str_replace('"', '"', $keywords);
return true;
}
return false;
}
/**
* Performs a search on keywords depending on display specific params. You have to run split_keywords() first.
*
* @param string $type contains either posts or topics depending on what should be searched for
* @param string $fields contains either titleonly (topic titles should be searched), msgonly (only message bodies should be searched), firstpost (only subject and body of the first post should be searched) or all (all post bodies and subjects should be searched)
* @param string $terms is either 'all' (use query as entered, words without prefix should default to "have to be in field") or 'any' (ignore search query parts and just return all posts that contain any of the specified words)
* @param array $sort_by_sql contains SQL code for the ORDER BY part of a query
* @param string $sort_key is the key of $sort_by_sql for the selected sorting
* @param string $sort_dir is either a or d representing ASC and DESC
* @param string $sort_days specifies the maximum amount of days a post may be old
* @param array $ex_fid_ary specifies an array of forum ids which should not be searched
* @param array $m_approve_fid_ary specifies an array of forum ids in which the searcher is allowed to view unapproved posts
* @param int $topic_id is set to 0 or a topic id, if it is not 0 then only posts in this topic should be searched
* @param array $author_ary an array of author ids if the author should be ignored during the search the array is empty
* @param string $author_name specifies the author match, when ANONYMOUS is also a search-match
* @param array &$id_ary passed by reference, to be filled with ids for the page specified by $start and $per_page, should be ordered
* @param int $start indicates the first index of the page
* @param int $per_page number of ids each page is supposed to contain
* @return boolean|int total number of results
*
* @access public
*/
function keyword_search($type, $fields, $terms, $sort_by_sql, $sort_key, $sort_dir, $sort_days, $ex_fid_ary, $m_approve_fid_ary, $topic_id, $author_ary, $author_name, &$id_ary, $start, $per_page)
{
global $config, $db, $auth;
// No keywords? No posts.
if (!strlen($this->search_query) && !sizeof($author_ary))
{
return false;
}
$id_ary = array();
$join_topic = ($type == 'posts') ? false : true;
// sorting
if ($type == 'topics')
{
switch ($sort_key)
{
case 'a':
$this->sphinx->SetGroupBy('topic_id', SPH_GROUPBY_ATTR, 'poster_id ' . (($sort_dir == 'a') ? 'ASC' : 'DESC'));
break;
case 'f':
$this->sphinx->SetGroupBy('topic_id', SPH_GROUPBY_ATTR, 'forum_id ' . (($sort_dir == 'a') ? 'ASC' : 'DESC'));
break;
case 'i':
case 's':
$this->sphinx->SetGroupBy('topic_id', SPH_GROUPBY_ATTR, 'post_subject ' . (($sort_dir == 'a') ? 'ASC' : 'DESC'));
break;
case 't':
default:
$this->sphinx->SetGroupBy('topic_id', SPH_GROUPBY_ATTR, 'topic_last_post_time ' . (($sort_dir == 'a') ? 'ASC' : 'DESC'));
break;
}
}
else
{
switch ($sort_key)
{
case 'a':
$this->sphinx->SetSortMode(($sort_dir == 'a') ? SPH_SORT_ATTR_ASC : SPH_SORT_ATTR_DESC, 'poster_id');
break;
case 'f':
$this->sphinx->SetSortMode(($sort_dir == 'a') ? SPH_SORT_ATTR_ASC : SPH_SORT_ATTR_DESC, 'forum_id');
break;
case 'i':
case 's':
$this->sphinx->SetSortMode(($sort_dir == 'a') ? SPH_SORT_ATTR_ASC : SPH_SORT_ATTR_DESC, 'post_subject');
break;
case 't':
default:
$this->sphinx->SetSortMode(($sort_dir == 'a') ? SPH_SORT_ATTR_ASC : SPH_SORT_ATTR_DESC, 'post_time');
break;
}
}
// most narrow filters first
if ($topic_id)
{
$this->sphinx->SetFilter('topic_id', array($topic_id));
}
$search_query_prefix = '';
switch($fields)
{
case 'titleonly':
// only search the title
if ($terms == 'all')
{
$search_query_prefix = '@title ';
}
$this->sphinx->SetFieldWeights(array("title" => 5, "data" => 1)); // weight for the title
$this->sphinx->SetFilter('topic_first_post', array(1)); // 1 is first_post, 0 is not first post
break;
case 'msgonly':
// only search the body
if ($terms == 'all')
{
$search_query_prefix = '@data ';
}
$this->sphinx->SetFieldWeights(array("title" => 1, "data" => 5)); // weight for the body
break;
case 'firstpost':
$this->sphinx->SetFieldWeights(array("title" => 5, "data" => 1)); // more relative weight for the title, also search the body
$this->sphinx->SetFilter('topic_first_post', array(1)); // 1 is first_post, 0 is not first post
break;
default:
$this->sphinx->SetFieldWeights(array("title" => 5, "data" => 1)); // more relative weight for the title, also search the body
break;
}
if (sizeof($author_ary))
{
$this->sphinx->SetFilter('poster_id', $author_ary);
}
if (sizeof($ex_fid_ary))
{
// All forums that a user is allowed to access
$fid_ary = array_unique(array_intersect(array_keys($auth->acl_getf('f_read', true)), array_keys($auth->acl_getf('f_search', true))));
// All forums that the user wants to and can search in
$search_forums = array_diff($fid_ary, $ex_fid_ary);
if (sizeof($search_forums))
{
$this->sphinx->SetFilter('forum_id', $search_forums);
}
}
$this->sphinx->SetFilter('deleted', array(0));
$this->sphinx->SetLimits($start, (int) $per_page, MAX_MATCHES);
$result = $this->sphinx->Query($search_query_prefix . str_replace('"', '"', $this->search_query), $this->indexes);
// could be connection to localhost:3312 failed (errno=111, msg=Connection refused) during rotate, retry if so
$retries = CONNECT_RETRIES;
while (!$result && (strpos($this->sphinx->_error, "errno=111,") !== false) && $retries--)
{
usleep(CONNECT_WAIT_TIME);
$result = $this->sphinx->Query($search_query_prefix . str_replace('"', '"', $this->search_query), $this->indexes);
}
$id_ary = array();
if (isset($result['matches']))
{
if ($type == 'posts')
{
$id_ary = array_keys($result['matches']);
}
else
{
foreach($result['matches'] as $key => $value)
{
$id_ary[] = $value['attrs']['topic_id'];
}
}
}
else
{
return false;
}
$result_count = $result['total_found'];
$id_ary = array_slice($id_ary, 0, (int) $per_page);
return $result_count;
}
/**
* Performs a search on an author's posts without caring about message contents. Depends on display specific params
*
* @param string $type contains either posts or topics depending on what should be searched for
* @param boolean $firstpost_only if true, only topic starting posts will be considered
* @param array $sort_by_sql contains SQL code for the ORDER BY part of a query
* @param string $sort_key is the key of $sort_by_sql for the selected sorting
* @param string $sort_dir is either a or d representing ASC and DESC
* @param string $sort_days specifies the maximum amount of days a post may be old
* @param array $ex_fid_ary specifies an array of forum ids which should not be searched
* @param array $m_approve_fid_ary specifies an array of forum ids in which the searcher is allowed to view unapproved posts
* @param int $topic_id is set to 0 or a topic id, if it is not 0 then only posts in this topic should be searched
* @param array $author_ary an array of author ids
* @param string $author_name specifies the author match, when ANONYMOUS is also a search-match
* @param array &$id_ary passed by reference, to be filled with ids for the page specified by $start and $per_page, should be ordered
* @param int $start indicates the first index of the page
* @param int $per_page number of ids each page is supposed to contain
* @return boolean|int total number of results
*
* @access public
*/
function author_search($type, $firstpost_only, $sort_by_sql, $sort_key, $sort_dir, $sort_days, $ex_fid_ary, $m_approve_fid_ary, $topic_id, $author_ary, $author_name, &$id_ary, $start, $per_page)
{
$this->search_query = '';
$this->sphinx->SetMatchMode(SPH_MATCH_FULLSCAN);
$fields = ($firstpost_only) ? 'firstpost' : 'all';
$terms = 'all';
return $this->keyword_search($type, $fields, $terms, $sort_by_sql, $sort_key, $sort_dir, $sort_days, $ex_fid_ary, $m_approve_fid_ary, $topic_id, $author_ary, $author_name, $id_ary, $start, $per_page);
}
/**
* Updates wordlist and wordmatch tables when a message is posted or changed
*
* @param string $mode Contains the post mode: edit, post, reply, quote
* @param int $post_id The id of the post which is modified/created
* @param string &$message New or updated post content
* @param string &$subject New or updated post subject
* @param int $poster_id Post author's user id
* @param int $forum_id The id of the forum in which the post is located
*
* @access public
*/
function index($mode, $post_id, &$message, &$subject, $poster_id, $forum_id)
{
global $config, $db;
if ($mode == 'edit')
{
$this->sphinx->UpdateAttributes($this->indexes, array('forum_id', 'poster_id'), array((int)$post_id => array((int)$forum_id, (int)$poster_id)));
}
else if ($mode != 'post' && $post_id)
{
// update topic_last_post_time for full topic
$sql = 'SELECT p1.post_id
FROM ' . POSTS_TABLE . ' p1
LEFT JOIN ' . POSTS_TABLE . ' p2 ON (p1.topic_id = p2.topic_id)
WHERE p2.post_id = ' . $post_id;
$result = $db->sql_query($sql);
$post_updates = array();
$post_time = time();
while ($row = $db->sql_fetchrow($result))
{
$post_updates[(int)$row['post_id']] = array((int) $post_time);
}
$db->sql_freeresult($result);
if (sizeof($post_updates))
{
$this->sphinx->UpdateAttributes($this->indexes, array('topic_last_post_time'), $post_updates);
}
}
if ($config['fulltext_sphinx_autorun'])
{
if ($this->index_created())
{
$rotate = ($this->searchd_running()) ? ' --rotate' : '';
$cwd = getcwd();
chdir($config['fulltext_sphinx_bin_path']);
exec('./' . INDEXER_NAME . $rotate . ' --config ' . $config['fulltext_sphinx_config_path'] . 'sphinx.conf index_phpbb_' . $this->id . '_delta >> ' . $config['fulltext_sphinx_data_path'] . 'log/indexer.log 2>&1 &');
// var_dump('./' . INDEXER_NAME . $rotate . ' --config ' . $config['fulltext_sphinx_config_path'] . 'sphinx.conf index_phpbb_' . $this->id . '_delta >> ' . $config['fulltext_sphinx_data_path'] . 'log/indexer.log 2>&1 &');
chdir($cwd);
}
}
}
/**
* Delete a post from the index after it was deleted
*/
function index_remove($post_ids, $author_ids, $forum_ids)
{
$values = array();
foreach ($post_ids as $post_id)
{
$values[$post_id] = array(1);
}
$this->sphinx->UpdateAttributes($this->indexes, array('deleted'), $values);
}
/**
* Destroy old cache entries
*/
function tidy($create = false)
{
global $config;
if ($config['fulltext_sphinx_autorun'])
{
if ($this->index_created() || $create)
{
$rotate = ($this->searchd_running()) ? ' --rotate' : '';
$cwd = getcwd();
chdir($config['fulltext_sphinx_bin_path']);
exec('./' . INDEXER_NAME . $rotate . ' --config ' . $config['fulltext_sphinx_config_path'] . 'sphinx.conf index_phpbb_' . $this->id . '_main >> ' . $config['fulltext_sphinx_data_path'] . 'log/indexer.log 2>&1 &');
exec('./' . INDEXER_NAME . $rotate . ' --config ' . $config['fulltext_sphinx_config_path'] . 'sphinx.conf index_phpbb_' . $this->id . '_delta >> ' . $config['fulltext_sphinx_data_path'] . 'log/indexer.log 2>&1 &');
chdir($cwd);
}
}
set_config('search_last_gc', time(), true);
}
/**
* Create sphinx table
*/
function create_index($acp_module, $u_action)
{
global $db, $user, $config;
$this->shutdown_searchd();
if (!isset($config['fulltext_sphinx_configured']) || !$config['fulltext_sphinx_configured'])
{
$user->add_lang('mods/fulltext_sphinx');
return $user->lang['FULLTEXT_SPHINX_CONFIGURE_FIRST'];
}
if (!$this->index_created())
{
$sql = 'CREATE TABLE IF NOT EXISTS ' . SPHINX_TABLE . ' (
counter_id INT NOT NULL PRIMARY KEY,
max_doc_id INT NOT NULL
)';
$db->sql_query($sql);
$sql = 'TRUNCATE TABLE ' . SPHINX_TABLE;
$db->sql_query($sql);
}
// start indexing process
$this->tidy(true);
$this->shutdown_searchd();
return false;
}
/**
* Drop sphinx table
*/
function delete_index($acp_module, $u_action)
{
global $db, $config;
$this->shutdown_searchd();
if ($config['fulltext_sphinx_autorun'])
{
sphinx_unlink_by_pattern($config['fulltext_sphinx_data_path'], '#^index_phpbb_' . $this->id . '.*$#');
}
if (!$this->index_created())
{
return false;
}
$sql = 'DROP TABLE ' . SPHINX_TABLE;
$db->sql_query($sql);
$this->shutdown_searchd();
return false;
}
/**
* Returns true if the sphinx table was created
*/
function index_created($allow_new_files = true)
{
global $db, $config;
$sql = 'SHOW TABLES LIKE \'' . SPHINX_TABLE . '\'';
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$db->sql_freeresult($result);
$created = false;
if ($row)
{
if ($config['fulltext_sphinx_autorun'])
{
if ((file_exists($config['fulltext_sphinx_data_path'] . 'index_phpbb_' . $this->id . '_main.spd') && file_exists($config['fulltext_sphinx_data_path'] . 'index_phpbb_' . $this->id . '_delta.spd')) || ($allow_new_files && file_exists($config['fulltext_sphinx_data_path'] . 'index_phpbb_' . $this->id . '_main.new.spd') && file_exists($config['fulltext_sphinx_data_path'] . 'index_phpbb_' . $this->id . '_delta.new.spd')))
{
$created = true;
}
}
else
{
$created = true;
}
}
return $created;
}
/**
* Kills the searchd process and makes sure there's no locks left over
*/
function shutdown_searchd()
{
global $config;
if ($config['fulltext_sphinx_autorun'])
{
if (!function_exists('exec'))
{
set_config('fulltext_sphinx_autorun', '0');
return;
}
exec('killall -9 ' . SEARCHD_NAME . ' >> /dev/null 2>&1 &');
if (file_exists($config['fulltext_sphinx_data_path'] . 'searchd.pid'))
{
unlink($config['fulltext_sphinx_data_path'] . 'searchd.pid');
}
sphinx_unlink_by_pattern($config['fulltext_sphinx_data_path'], '#^.*\.spl$#');
}
}
/**
* Checks whether searchd is running, if it's not running it makes sure there's no left over
* files by calling shutdown_searchd.
*
* @return boolean Whether searchd is running or not
*/
function searchd_running()
{
global $config;
// if we cannot manipulate the service assume it is running
if (!$config['fulltext_sphinx_autorun'])
{
return true;
}
if (file_exists($config['fulltext_sphinx_data_path'] . 'searchd.pid'))
{
$pid = trim(file_get_contents($config['fulltext_sphinx_data_path'] . 'searchd.pid'));
if ($pid)
{
$pid = trim($pid);
$output = array();
$pidof_command = 'pidof';
exec('whereis -b pidof', $output);
if (sizeof($output) > 1)
{
$output = explode(' ', $output[0]);
$pidof_command = $output[1]; // 0 is pidof:
}
unset($output);
exec($pidof_command . ' ' . SEARCHD_NAME, $output);
if (sizeof($output) && (trim($output[0]) == $pid || trim($output[1]) == $pid))
{
return true;
}
}
}
// make sure it's really not running
$this->shutdown_searchd();
return false;
}
/**
* Returns an associative array containing information about the indexes
*/
function index_stats()
{
global $user;
if (empty($this->stats))
{
$this->get_stats();
}
$user->add_lang('mods/fulltext_sphinx');
return array(
$user->lang['FULLTEXT_SPHINX_MAIN_POSTS'] => ($this->index_created()) ? $this->stats['main_posts'] : 0,
$user->lang['FULLTEXT_SPHINX_DELTA_POSTS'] => ($this->index_created()) ? $this->stats['total_posts'] - $this->stats['main_posts'] : 0,
$user->lang['FULLTEXT_MYSQL_TOTAL_POSTS'] => ($this->index_created()) ? $this->stats['total_posts'] : 0,
$user->lang['FULLTEXT_SPHINX_LAST_SEARCHES'] => nl2br($this->stats['last_searches']),
);
}
/**
* Collects stats that can be displayed on the index maintenance page
*/
function get_stats()
{
global $db, $config;
if ($this->index_created())
{
$sql = 'SELECT COUNT(post_id) as total_posts
FROM ' . POSTS_TABLE;
$result = $db->sql_query($sql);
$this->stats['total_posts'] = (int) $db->sql_fetchfield('total_posts');
$db->sql_freeresult($result);
$sql = 'SELECT COUNT(p.post_id) as main_posts
FROM ' . POSTS_TABLE . ' p, ' . SPHINX_TABLE . ' m
WHERE p.post_id <= m.max_doc_id
AND m.counter_id = 1';
$result = $db->sql_query($sql);
$this->stats['main_posts'] = (int) $db->sql_fetchfield('main_posts');
$db->sql_freeresult($result);
}
$this->stats['last_searches'] = '';
if ($config['fulltext_sphinx_autorun'])
{
if (file_exists($config['fulltext_sphinx_data_path'] . 'log/sphinx-query.log'))
{
$last_searches = explode("\n", utf8_htmlspecialchars(sphinx_read_last_lines($config['fulltext_sphinx_data_path'] . 'log/sphinx-query.log', 3)));
foreach($last_searches as $i => $search)
{
if (strpos($search, '[' . $this->indexes . ']') !== false)
{
$last_searches[$i] = str_replace('[' . $this->indexes . ']', '', $search);
}
else
{
$last_searches[$i] = '';
}
}
$this->stats['last_searches'] = implode("\n", $last_searches);
}
}
}
/**
* Returns a list of options for the ACP to display
*/
function acp()
{
global $user, $config;
$user->add_lang('mods/fulltext_sphinx');
$config_vars = array(
'fulltext_sphinx_autoconf' => 'bool',
'fulltext_sphinx_autorun' => 'bool',
'fulltext_sphinx_config_path' => 'string',
'fulltext_sphinx_data_path' => 'string',
'fulltext_sphinx_bin_path' => 'string',
'fulltext_sphinx_port' => 'int',
'fulltext_sphinx_stopwords' => 'bool',
'fulltext_sphinx_indexer_mem_limit' => 'int',
);
$defaults = array(
'fulltext_sphinx_autoconf' => '1',
'fulltext_sphinx_autorun' => '1',
'fulltext_sphinx_indexer_mem_limit' => '512',
);
foreach ($config_vars as $config_var => $type)
{
if (!isset($config[$config_var]))
{
$default = '';
if (isset($defaults[$config_var]))
{
$default = $defaults[$config_var];
}
set_config($config_var, $default);
}
}
$no_autoconf = false;
$no_autorun = false;
$bin_path = $config['fulltext_sphinx_bin_path'];
// try to guess the path if it is empty
if (empty($bin_path))
{
if (@file_exists('/usr/local/bin/' . INDEXER_NAME) && @file_exists('/usr/local/bin/' . SEARCHD_NAME))
{
$bin_path = '/usr/local/bin/';
}
else if (@file_exists('/usr/bin/' . INDEXER_NAME) && @file_exists('/usr/bin/' . SEARCHD_NAME))
{
$bin_path = '/usr/bin/';
}
else
{
$output = array();
if (!function_exists('exec') || null === @exec('whereis -b ' . INDEXER_NAME, $output))
{
$no_autorun = true;
}
else if (sizeof($output))
{
$output = explode(' ', $output[0]);
array_shift($output); // remove indexer:
foreach ($output as $path)
{
$path = dirname($path) . '/';
if (file_exists($path . INDEXER_NAME) && file_exists($path . SEARCHD_NAME))
{
$bin_path = $path;
break;
}
}
}
}
}
if ($no_autorun)
{
set_config('fulltext_sphinx_autorun', '0');
}
if ($no_autoconf)
{
set_config('fulltext_sphinx_autoconf', '0');
}
// rewrite config if fulltext sphinx is enabled
if ($config['fulltext_sphinx_autoconf'] && isset($config['fulltext_sphinx_configured']) && $config['fulltext_sphinx_configured'])
{
$this->config_updated();
}
// check whether stopwords file is available and enabled
if (@file_exists($config['fulltext_sphinx_config_path'] . 'sphinx_stopwords.txt'))
{
$stopwords_available = true;
$stopwords_active = $config['fulltext_sphinx_stopwords'];
}
else
{
$stopwords_available = false;
$stopwords_active = false;
set_config('fulltext_sphinx_stopwords', '0');
}
$tpl = '
<span class="error">' . $user->lang['FULLTEXT_SPHINX_CONFIGURE_BEFORE']. '</span>
<dl>
<dt><label for="fulltext_sphinx_autoconf">' . $user->lang['FULLTEXT_SPHINX_AUTOCONF'] . ':</label><br /><span>' . $user->lang['FULLTEXT_SPHINX_AUTOCONF_EXPLAIN'] . '</span></dt>
<dd><label><input type="radio" id="fulltext_sphinx_autoconf" name="config[fulltext_sphinx_autoconf]" value="1"' . (($config['fulltext_sphinx_autoconf']) ? ' checked="checked"' : '') . (($no_autoconf) ? ' disabled="disabled"' : '') . ' class="radio" /> ' . $user->lang['YES'] . '</label><label><input type="radio" name="config[fulltext_sphinx_autoconf]" value="0"' . ((!$config['fulltext_sphinx_autoconf']) ? ' checked="checked"' : '') . ' class="radio" /> ' . $user->lang['NO'] . '</label></dd>
</dl>
<dl>
<dt><label for="fulltext_sphinx_autorun">' . $user->lang['FULLTEXT_SPHINX_AUTORUN'] . ':</label><br /><span>' . $user->lang['FULLTEXT_SPHINX_AUTORUN_EXPLAIN'] . '</span></dt>
<dd><label><input type="radio" id="fulltext_sphinx_autorun" name="config[fulltext_sphinx_autorun]" value="1"' . (($config['fulltext_sphinx_autorun']) ? ' checked="checked"' : '') . (($no_autorun) ? ' disabled="disabled"' : '') . ' class="radio" /> ' . $user->lang['YES'] . '</label><label><input type="radio" name="config[fulltext_sphinx_autorun]" value="0"' . ((!$config['fulltext_sphinx_autorun']) ? ' checked="checked"' : '') . ' class="radio" /> ' . $user->lang['NO'] . '</label></dd>
</dl>
<dl>
<dt><label for="fulltext_sphinx_config_path">' . $user->lang['FULLTEXT_SPHINX_CONFIG_PATH'] . ':</label><br /><span>' . $user->lang['FULLTEXT_SPHINX_CONFIG_PATH_EXPLAIN'] . '</span></dt>
<dd><input id="fulltext_sphinx_config_path" type="text" size="40" maxlength="255" name="config[fulltext_sphinx_config_path]" value="' . $config['fulltext_sphinx_config_path'] . '" /></dd>
</dl>
<dl>
<dt><label for="fulltext_sphinx_bin_path">' . $user->lang['FULLTEXT_SPHINX_BIN_PATH'] . ':</label><br /><span>' . $user->lang['FULLTEXT_SPHINX_BIN_PATH_EXPLAIN'] . '</span></dt>
<dd><input id="fulltext_sphinx_bin_path" type="text" size="40" maxlength="255" name="config[fulltext_sphinx_bin_path]" value="' . $bin_path . '" /></dd>
</dl>
<dl>
<dt><label for="fulltext_sphinx_data_path">' . $user->lang['FULLTEXT_SPHINX_DATA_PATH'] . ':</label><br /><span>' . $user->lang['FULLTEXT_SPHINX_DATA_PATH_EXPLAIN'] . '</span></dt>
<dd><input id="fulltext_sphinx_data_path" type="text" size="40" maxlength="255" name="config[fulltext_sphinx_data_path]" value="' . $config['fulltext_sphinx_data_path'] . '" /></dd>
</dl>
<span class="error">' . $user->lang['FULLTEXT_SPHINX_CONFIGURE_AFTER']. '</span>
<dl>
<dt><label for="fulltext_sphinx_stopwords">' . $user->lang['FULLTEXT_SPHINX_STOPWORDS_FILE'] . ':</label><br /><span>' . $user->lang['FULLTEXT_SPHINX_STOPWORDS_FILE_EXPLAIN'] . '</span></dt>
<dd><label><input type="radio" id="fulltext_sphinx_stopwords" name="config[fulltext_sphinx_stopwords]" value="1"' . (($stopwords_active) ? ' checked="checked"' : '') . ((!$stopwords_available) ? ' disabled="disabled"' : '') . ' class="radio" /> ' . $user->lang['YES'] . '</label><label><input type="radio" name="config[fulltext_sphinx_stopwords]" value="0"' . ((!$stopwords_active) ? ' checked="checked"' : '') . ' class="radio" /> ' . $user->lang['NO'] . '</label></dd>
</dl>
<dl>
<dt><label for="fulltext_sphinx_port">' . $user->lang['FULLTEXT_SPHINX_PORT'] . ':</label><br /><span>' . $user->lang['FULLTEXT_SPHINX_PORT_EXPLAIN'] . '</span></dt>
<dd><input id="fulltext_sphinx_port" type="text" size="4" maxlength="10" name="config[fulltext_sphinx_port]" value="' . $config['fulltext_sphinx_port'] . '" /></dd>
</dl>
<dl>
<dt><label for="fulltext_sphinx_indexer_mem_limit">' . $user->lang['FULLTEXT_SPHINX_INDEXER_MEM_LIMIT'] . ':</label><br /><span>' . $user->lang['FULLTEXT_SPHINX_INDEXER_MEM_LIMIT_EXPLAIN'] . '</span></dt>
<dd><input id="fulltext_sphinx_indexer_mem_limit" type="text" size="4" maxlength="10" name="config[fulltext_sphinx_indexer_mem_limit]" value="' . $config['fulltext_sphinx_indexer_mem_limit'] . '" />' . $user->lang['MIB'] . '</dd>
</dl>
';
// These are fields required in the config table
return array(
'tpl' => $tpl,
'config' => $config_vars
);
}
}
/**
* Deletes all files from a directory that match a certain pattern
*
* @param string $path Path from which files shall be deleted
* @param string $pattern PCRE pattern that a file needs to match in order to be deleted
*/
function sphinx_unlink_by_pattern($path, $pattern)
{
$dir = opendir($path);
while (false !== ($file = readdir($dir)))
{
if (is_file($path . $file) && preg_match($pattern, $file))
{
unlink($path . $file);
}
}
closedir($dir);
}
/**
* Reads the last from a file
*
* @param string $file The filename from which the lines shall be read
* @param int $amount The number of lines to be read from the end
* @return string Last lines of the file
*/
function sphinx_read_last_lines($file, $amount)
{
$fp = fopen($file, 'r');
fseek($fp, 0, SEEK_END);
$c = '';
$i = 0;
while ($i < $amount)
{
fseek($fp, -2, SEEK_CUR);
$c = fgetc($fp);
if ($c == "\n")
{
$i++;
}
if (feof($fp))
{
break;
}
}
$string = fread($fp, 8192);
fclose($fp);
return $string;
}
?>