These are not distinct categories, they are layers: text files are streams of characters encoded as streams of bytes.
It has to be said that for data interchange, text-based formats have proven advantages. But even there, there are cases where optimization to save space can be justified: hence EXI.