I think you pretty much said it all, from what I've read and gathered around here from people who actually worked on it - in a nutshell, that's just what happened. Too bad, not just for Disney and the audience, but because I enjoyed the books they were based on (even if they were kinda "Welsh Tolkein Lite for kids").