The nuclei structure has a significant interpretation for cancer analysis in histopathological microscopic images. In this paper, we analyze hepatocellular carcinoma in 100x magnification from nuclear chromatin patterns. The multispectral imaging is a new potential technique for histopathology. It may provide an alternative to pathologists to see additional information. This paper utilizes multispectral images which have spatial and spectral information for nuclear analysis. The proposed framework is based on texture analysis of nuclei. The system aim to analyze the significant of multispectral bands for discriminating cancer and non-cancer nuclei. The textural features were extracted using Gabor descriptors. We present nuclei textural feature with 30 Gabor patterns at different scales and orientations. Bag-of-visual-word model with random forest classifier is employed to classify normal and cancer cells. Moreover, we remove irrelevant Gabor parameters using optimization algorithm, which achieve high recognition performance significantly. Experimental result shows that our approach achieves approximately 99% of classification accuracy.