You can install codecs to make it support all the formats you need, but you might as well download any of these awesome music players instead. Windows comes with Windows Media Player, which is a pretty decent app except for its limited file format support.
That's why having a good music player on your Windows machine is useful.
The world may be moving to some awesome music streaming services or even streaming music off YouTube, but a lot of people have a large music collection stored offline.
