"I have paid 2 payments on the day they were due, and both times they have assessed me a $39.00 late fee on the day it was due."
This can be a problem with any credit card payment, since they all love to charge late fees whenever possible. If you make a payment on the day it's due, it will only post if you've made it during normal banking hours. If it's made after the banks have closed out their transactions for the day, the bank will post the payment on the next banking day. I've seen this same issue with Chase and FIA (Bank of America).
"I keep a small balance on this card to keep up appearances since this is my oldest credit history."
Suggestion : You don't need to keep a balance (and pay crazy interest) on a card to keep it in good standing on your credit report. If you pay it off in full each month, your report will still show a series of regular on time payments to the account. That's what makes your credit score look good. I've done this with a few credit cards and managed to keep my score above 800 without paying a penny of interest.