Is it just as cheap to walk into hotels in Thailand than to book ...

Hotel rooms booked at the airport hotel counter are not too bad. Sometimes a little more expensive that pre-booked, but often around the same price. Also, you can book hotel room in travel agencies in Thailand itself. ...