Futuremark has introduced a new handheld device benchmark called SPMarkJava06. This tool was developed in cooperation with companies as ARM, ATI, Bitboys, DMP, Falanx, Imagination Technologies, Intel, Khronos Group, NVIDIA and Symbian.
The SPMarkJava06 benchmark should provide reliable, unbiased results across
different architectures and environments.
There are professional editions which cost thousands of dollars per license and there are also two consumer versions available. The Advanced Edition costs $3 per license. It offers full features and a playable game but there's also a Basic Edition available for free.