Tag Info

Hot answers tagged

1

I would write the raw data to a very basic table without indexes or constraints, not even a primary key. If you can, insert many rows at once, that's faster than single-row inserts. If you can afford loosing some data in a catastrophic event, make that an unlogged table, that's faster. If you can afford loosing some data in a catastrophic event and all ...


1

It's the file size that's the problem. Essentially there's a timeout expiring somewhere, the server logs will tell you where. When the timeout expires, no more data is produced, and after a while with no data the connection gets closed as per normal. The last time I had to tackle something like this (Which is a long time ago now), I wrote a small program ...



Only top voted, non community-wiki answers of a minimum length are eligible