With the development of electronic engineering technology, diversifications of devices are being created. Moreover, computing machines are more accessible and with the development of communication technology, entrance of new products related with ubiquitous paradigm are appearing. Ubiquitous computing device are connected within it, and they are convergence. Consequently, there is need of new methodology of device evaluation. In this paper, by collecting and integrating the current usability factor and ubiquitous characteristic factors, Ubiquitous Evaluation Factors are derived. Usability evaluation of each part of the Ubiquitous device, decomposition is performed. It is able to obtain the evaluation score of the device components from usability evaluation and score of the evaluation done in each usability factor. This framework is developed by web-based system allowing real product evaluation, and making comparison of the usability evaluation score obtained. Though this framework, usability test on ubiquitous device is simplified and systematized.