What is the limit for File size?

[K2ouMais]

Hello everyone,

I am trying to import a 1,2GB CSV file into my database and it takes really long to do it.

It has about 2.1m rows and 288 columns.

I dont need every column. I am using the class "WithHeadingRow", to map and use only the columns I need.

I use Batches (5) and Chunks (5) and still It is taking ages for me to see the first 5 rows in my DB.

Could this be a problem with docker (Laravel Sail) or does it take this long?

Thank you

[patrickbrouwers]

When using WithHeadingRow it will still have to select all columns first (so all 288). If you only need the first x columns you could try the WithColumnLimit concern. Otherwise you could have to look at ReadFilters, using WithReadFilter which expects a PhpSpreadsheet read filter you can implement yourself. https://phpoffice.github.io/PhpSpreadsheet/classes/PhpOffice-PhpSpreadsheet-Reader-IReadFilter.html

[K2ouMais]

Will take a look at it. Thank you for the response. 👍🏻