11 added 536 characters in body
source | link

For anyone still following or maybe if you happened on this thread

100 files with 1,000 GROUP nodes each - 25 seconds

40 files with 2,500 GROUP nodes each - 24 seconds

20 files with 5,000 GROUP nodes each - 24 seconds

10 files with 10,000 GROUP nodes each - 24 seconds

4 files with 25,000 GROUP nodes each - 20 seconds

2 files with 50,000 GROUP nodes each - 22 seconds

1 file with 100,000 GROUP nodes - 22 seconds

For anyone still following or maybe if you happened on this thread

100 files with 1,000 GROUP nodes each - 25 seconds

40 files with 2,500 GROUP nodes each - 24 seconds

20 files with 5,000 GROUP nodes each - 24 seconds

10 files with 10,000 GROUP nodes each - 24 seconds

4 files with 25,000 GROUP nodes each - 20 seconds

2 files with 50,000 GROUP nodes each - 22 seconds

1 file with 100,000 GROUP nodes - 22 seconds

10 added 13 characters in body; added 3 characters in body; added 16 characters in body
source | link
  1. What is going to be the difference in xml to RDBMS conversion between 1 row of 50k GROUP Nodes and 5 rows of 10k GROUP Nodes?

  2. Converting 1 xml of 50k GROUP Nodes to 5 xmls of 10k GROUP Nodes takes a while (I did it with Excel VBA...I know I could use something else but its what I have and know). Im guessguessing the most judicious way of going about it will probably do some XSLT work (this is something I need to learn)

  3. In doing this it made me wonder if there was a quicker way to parse the xml into smaller10k node pieces into avia the sql server xml variable in sql server itand would it be much quicker than doing it outside of sql server (I don't know where to begin here).

  1. What is going to be the difference in conversion between 1 row of 50k GROUP Nodes and 5 rows of 10k GROUP Nodes?

  2. Converting 1 xml of 50k GROUP Nodes to 5 xmls of 10k GROUP Nodes takes a while (I did it with Excel VBA...I know I could use something else but its what I have and know). Im guess the most judicious way of going about it will probably do some XSLT work (this is something I need to learn)

  3. In doing this it made me wonder if there was a quicker way to parse the xml into smaller pieces into a variable in sql server it would be much quicker than doing it outside of sql server (I don't know where to begin here).

  1. What is going to be the difference in xml to RDBMS conversion between 1 row of 50k GROUP Nodes and 5 rows of 10k GROUP Nodes?

  2. Converting 1 xml of 50k GROUP Nodes to 5 xmls of 10k GROUP Nodes takes a while (I did it with Excel VBA...I know I could use something else but its what I have and know). Im guessing the most judicious way of going about it will probably do some XSLT work (this is something I need to learn)

  3. In doing this it made me wonder if there was a quicker way to parse the xml into 10k node pieces via the sql server xml variable in sql server and would it be quicker than doing it outside of sql server (I don't know where to begin here).

9 added 4482 characters in body
source | link

Update just in case anyone is interested, I will provide at the end of this post what I'm actually doing to solve this, just because I've found some interesting things.

Update 10/30/2018. Just in case anyone is interested, I have started to document at the end of this post what I'm actually doing to solve this, just because I've found some interesting things.

Update 10/30/2018Update 10/30/2018

NOTE: I used the query timer in the bottom leftright hand corner so precision here is 1 second.

Update just in case anyone is interested, I will provide at the end of this post what I'm actually doing to solve this, just because I've found some interesting things.

Update 10/30/2018

NOTE: I used the query timer in the bottom left hand corner so precision here is 1 second.

Update 10/30/2018. Just in case anyone is interested, I have started to document at the end of this post what I'm actually doing to solve this, just because I've found some interesting things.

Update 10/30/2018

NOTE: I used the query timer in the bottom right hand corner so precision here is 1 second.

8 added 4482 characters in body
source | link
    Tweeted twitter.com/StackDBAs/status/1055746126622670849
7 deleted 2 characters in body
source | link
6 added 43 characters in body
source | link
5 added 43 characters in body
source | link
4 added 2 characters in body
source | link
3 added 2 characters in body
source | link
2 added 2 characters in body
source | link
1
source | link