You can stay in PWD guesthouses. If the rooms are vacant, you may get it at nominal rates after bargaining with the care taker.
As it is an official guest house, the rooms are clean and tidy. So you might like it.
However there are some private hotels, I guess 2 or 3. But not that great.