I recently had a baby without knowing i was pregnant; daddy's momma drama.?

I recently had a baby without knowing and so now the daddy has become an ***. I had to grow up in just a couple of days and its now been about 3 months and he still doesn't have a job. He always says I am wrong and whines because he never gets to see the baby. No one is stopping him from seeing the baby, but his mom wants to see the baby too. The grandparents have no rights, so I don't see what the big deal is. The baby's daddy's momma doesn't use wipes when changing pee diapers and doesn't let the dad hold the baby when they do get to see it. I recently broke up with him because I was tired of hurting and being the only one to go to work. People have told me that I should just give him time, but I think 3 months is more than enough time to grow up? If he really loved me and the baby, he would be more supportive of me and not his mom right? I really need help because I try to be nice to them but his mom always cries when I bring the baby to see them, even at a basketball game. Is this family like crazy or something?