Postgres Invalid size memory allocation
The server is ec2 with c5.xlarge
The data in the row is exceeding 1 gb size
So is the reason for this error
‘Invalid size memory allocation ‘
How to fix ?
Is any configuration required to change ?
Solution :
In most cases relational databases do not handle batch processing of large amounts of data very well, not the least of which is RDBMS logging requirements, which set a maximum limit on data changes in one transaction.
Moving lots of data in is an operational concern, so an operational approach is a good and logical choice.
Break your file up,externally to the DB (using command line tools), into many smaller files of say 10K each and load them as you would the single large file – keep the chunking logic outside the DB
Contact Us
Login with Google