I think food was a big problem, but I don't understand how it could have happened. The war was fought in the South where the food was grown. The North had to bring their food with them. Yet it was the Southerners that suffered the most hunger.
I think this happened because the North knew the South had food and ravaged it. They probably burnt crops as they went.