A proper user experience. VLC on Android is absolute ass. The battery won't drain like absolute ass. Nor will this affect your phone's battery if you also use it for different things. It doesn't bloat your phone out, and if you lost your phone, you'd still have your music with you. If something's broken or lacking in your iPod, you can just replace it, like your battery, you can't do the same with modern phones. I just recommend iPods because they just-werk, at least, if you have an older MacBook or a Windows computer. All iPods are still completely supported with 'modern' iTunes, you can sync, rip and listen without any hassle as if it's 2010. The music quality isn't bad, if you enjoy listening to CD-quality tracks, it will basically be on-par. Hook up IEMs to your li'l music device and you have a perfectly portable music device. -- Also, the clickwheel is fun.
I'm just a bit of a naught'ies fanatic and enjoy most-if-not-all stuff from the 2000's, so I'm a bit biased. Do NOT get the shuffles, they suck, get classics, nano's or mini.