If you know the story from manga, you'd know what he is fighting next and why he is still too weak right now. If you pay attention, you'd notice that fighting human has never been the main focus in the series.