Would i lose custody of my kids?

I moved out of town to get a house that was also cheaper rent then were i was living and i left my kids with my grandparents who raised me and i had to remodel the house well it took a month and when i went back to get my kids and they had went and find neglect and abandonment on me my social worker looked into the case and said it was not neglect so he dropped that charge and said it was nobodies fault abandonment and well the house is done and and i have a job so in your alls opinion will i lose custody of the kids? he also said if i did lose custody it wouldn't be permanent it would be just until i got on my feet so how long would the court give me?