Bombadil is the physical incarnation of the music of the Ainur. Just as Ungoliant is a physical incarnation of Morgoth/Melkor's discourse. That's why he is described as being there before the beginning.