The work presented in this paper, explored the enhancement of User Experience (UX) by introducing a novel gesture-based controller in a mobile multiplayer Virtual Reality (VR) game. Using only the smartphone's RGB camera, the image input was used for both gesture analysis, capable of understanding user actions, as well as segmenting the real hand that was illustrated in the Virtual Environment (VE). Users were also able to share the VR space by cooperating in a survival-strategy scenario. The results from the user studies indicated that both the bare hand controller and the addition of another player in the VR scene, affected the experience for the participants. Users had a stronger feeling of presence in the VE when participated with an other user, and the visual representation of their hand in the VR world made the interactions seem more natural. Even though, there is still a number of limitations, this project nodes this approach capable of offering a natural and engaging solution of VR interaction, capable of rich UX while maintaining a low entry level for the end users.