You can't really use the Perspective Mode for your case because your floor is not flat. Only the Free Camera mode allows for free movements, if you want to use the Perspective Mode anyway, you need to use the SetGroundHeight() method to change the virtual floor at your character level.