Intercontinental Hotels Reservations by phone Baltimore Maryland

I tried to reserve a room for the New Years Eve celebration at this Hotel. There is a fireworks display at the Harbor so I aske for a room on the upper level of the hotel. I tried to make reservations in November to assure a good room. I spoke to someone not of this country and was told I could get a room on the 11th floor and I agreed to make reservations. Gave credit card info and got a confirmation number. Then I asked for the reservation person to confirm what I requested and at that time was told that no quarentee of an upper room could be made by her. Now is when I was told there was not an 11th floor. Was also told that I could possible be on the ground level. I asked what happened to the request of being on an upper floor and was told that it is first come first served on room assignments. Asked at that time to cancel the reservation and was given a cancellation number. Not knowing that I was going to be charged FULL rate for the room for having a 20 minute conversation which cost over $500.

Now I ask ? Have I been ripped off ? At no time was I told I would be billed. I contactacted the credit card co. and they seem to agree with the hotel. This was not an internet reservation.
What can I do now ?

Bob
Galena, Maryland
U.S.A.