Eventually I find what went wrong, it should be caused by both Zend OPcache and XCache are installed, they may conflict each other in this case, once I've removed the XCache, it works fine, the php command line would no longer cause the php-fpm error.

XCache should be unnecessary when OPcache is running.