And lo, they were scattered on the Earth and their language was multitude

codecs specify how video and audio are encoded
container formats vs. codecs
lossless vs. lossy formats: why MP3s are so small
A list of codecs
many are proprietary: Why closed formats hurt Linux