使用标记器时QUEX_PATH问题

QUEX_PATH issue while using tokenizer

本文关键字：QUEX PATH 问题      更新时间：2023-10-16

我正在尝试安装可训练的标记器。我已经按照README安装了所有的依赖项。这是trainable-tokenizer https://github.com/jirkamarsik/trainable-tokenizer。我使用来自quex.org的安装程序安装了quex.deb，这是可训练的tokenizer的依赖项。

当我尝试做sudo make install时，我得到以下错误

ThinkPad-T430:~/tmp/OpenFST/tokenizer/trainable-tokenizer/src$ sudo make install 
[  6%] Building FeaturesReader with quex
Environment variable QUEX_PATH has not been defined.
error: environment variable 'QUEX_PATH' is not defined.
error: your system is 'posix'.
error: if you are using bash-shell, append the following line
error: to your '~/.bashrc' file:
error:
error: export QUEX_PATH=directory-where-quex-has-been-installed
make[2]: *** [quex_files/trtok_read_features_FeaturesReader] Error 255
make[1]: *** [CMakeFiles/trtok.dir/all] Error 2
make: *** [all] Error 2

但是我已经设置了QUEX_PATH。

ThinkPad-T430:~/tmp/OpenFST/tokenizer/trainable-tokenizer/src$ echo $QUEX_PATH 
/opt/quex/quex-0.65.4/
ThinkPad-T430:~/tmp/OpenFST/tokenizer/trainable-tokenizer/src$ ll /opt/quex/quex-0.65.4/
total 68
drwxrwxr-x 5 root root  4096 May 25 17:42 ./
drwxrwxr-x 3 root root  4096 May 25 17:42 ../
-rw-r--r-- 1 root root   181 Oct 13  2013 COPYRIGHT.txt
drwxr-xr-x 5 root root  4096 May 25 17:42 demo/
-rw-r--r-- 1 root root     0 Feb 26 02:01 __init__.py
-rwxr-xr-x 1 root root 26424 Oct 13  2013 LGPL.txt*
drwxr-xr-x 2 root root  4096 May 25 17:42 manpage/
drwxr-xr-x 6 root root  4096 May 25 18:02 quex/
-rw-r--r-- 1 root root  3098 Oct 13  2013 quex.bat
-rwxrwxr-x 1 root root  2649 Feb 26 02:01 quex-exe.py*
-rw-r--r-- 1 root root  4074 Oct 13  2013 README
-rw-rw-r-- 1 root root   118 Mar 22 15:22 unit_test_results.txt

我还在.bashrc中加入了export QUEX_PATH=/opt/quex/quex-0.65.4/ 

ThinkPad-T430:~/tmp/OpenFST/tokenizer/trainable-tokenizer/src$ vim ~/.bashrc
ThinkPad-T430:~/tmp/OpenFST/tokenizer/trainable-tokenizer/src$ echo $QUEX_PATH 
/opt/quex/quex-0.65.4/
ThinkPad-T430:~/tmp/OpenFST/tokenizer/trainable-tokenizer/src$ sudo make install
[  6%] Building FeaturesReader with quex
Environment variable QUEX_PATH has not been defined.
error: environment variable 'QUEX_PATH' is not defined.
error: your system is 'posix'.

但是我仍然得到相同的错误

我使用-I标志修复了这个问题。我必须使用quex -I

我猜真正的问题是你的python是python 3.0+而不是python 2.7，这是Quex所需要的。

相关文章：