There are few points that can actually have a negative impact on your website rankings like -
Server is Often Inaccessible to Bots.
Duplicate Content
Duplicate Title/Meta tags
External Links to Spam Sites
And Keyword Stuffing Ofcourse!
So, always check this points in your website.