payday loan cash yes/liberty took 34.19 from my bank account and refused to give me back my money..but cancelled my memebership which i didnt even subscribe to Internet

I currently applied for an online cash advance but completed the application over the phone and didnt subscribe to any other offers and have had money missing from my account within the next week. The total was 34.19 via checking account when I called the number the bank gave me I spoke with 3 different people whom could not verify what I actually subscribed to and told me to report fraud on here. What kind of company takes money and confirms by cancelling account and doesnt refund the money they know they took instead direct me here! I believe the company was Liberty discount.