Performance is primarily driven by the number of Rows by Columns. The .XLS file format has a lower row and column limitation than the .XLSX file format. The .XLSX file format is the default for that reason.
There is a hard-cap for export/import data size, currently at around 2,120,000 cells. See more here.