Medical Service Group Suspicious scamming! St. Petersburg Florida

He had a very thick... accent that was hard to understand. He wanted to know if I had insurance or medicare. I said neither..mainecare. when he wanted my card id#...I told him my card was in my wallet, in my purse, upstairs, which I can't climb because I just had surgery and I'm temporarily home alone. So he wanted the last 4 digits of my social which I hope I haven't screwed myself by giving it to him!!  Then again he asked if I could get the card and again I  said no,,call me back. He asked when and I  told him I  don't know...it's hit or miss! He said he'd call back, but I have no intentions in answering! Am I  screwed already?