can my landlord evict me for having visitors?

I moved into a 2 bedroom apt in a 2 floor house with my husband and my 3 year old autistic son in december 2010. 2 weeks into the month i had my husband’s family come over to watch the game and have the kids play in our new home while suddenly a weird scary guy comes upstairs and starts threatening me about the noise level in my apt at 5pm which in no way is disrespctful in time. he begins to threaten my family calling us racist names and it was a bad situation. it was scary and embarrassing that i had to call the cops the next morning because he came to our door again to threaten us that he would do watever it takes to get us out.i file a police report and comes to find out that he is the son of the owner of the house with severe mental issues that the owners never mentioned. i been afraid to even have my kid play or have anyone comeover till today. my husband had his 3 friends over to watch the game at 4pm and left at 9pm. at 10:30 the cops are knocking on my door saying that we were making loud noises. the owners have my contact numbers and can walk upstairs if they need to if there was loud noises yet they call the police on us without notice.this is the second time this occurred and they told the cops that if it happens again they will send us to court. the first time it happened i spoke to the owner on the phone and told them they can contact me anytime if theres a problem . keep in mind i have complained about not having any heat in one of my bedrooms and the bathroom several times and no answer. we do not make loud noises because of my sons condition and we dont have alot of friends because we work and take care of our son.we pay our rent on time even couple of days before due date.i want to know if they can evict us for having family over if thats the only reason they are upset about?