At the moment, we have powerBI set up to extract data directly out of excel files. However, we are running out of memory to create the dataset and looking to make use of the DirectQuery function of PowerBI
The database software to be DirectQueried should be able to extract millions of rows of data out of hundreds of excel files. The amount of data is continuously expanding.
Then PowerBI should be able to DirectQuery this datasource.
We hope this solution would allow us to keep making relevant reports out of the ever expanding amount of data.
The question is, what beginner friendly database software would be good to use out of the extensive list of possible data sources that can be direct queried.