increase the Max Memory Size

[mohit_symb]

Hi,

I am getting following error:

Not enough memory to extend hash table in VHT@9 to 1025 keys (phase:
allocate).

Increase the max_memory_size parameter or consult the
Vectorwise User Guide for other solutions

which file need to be configured

[makni01]

vectorwise.conf
How much memory does your machine have?

[mohit_symb]

hi,

My machine is having 24gb ram. I am trying to insert just 10MB CSV file using tIngresSCD(Slowly Changing Dimension) component in Ingres Vectorwise databse using talend(JasperETl) and its taking hours to upload a small data . why should i go for it when its performance is even poor than rest of the database???. If I increase data size it throws max_memory_size error? The values in Vectowise are set default. It means it is using 12gb for query processing. Is the ram less to query just few MB of data??

[marcin]

We are aware of a problem with the way Talend does SCD loading, causing very bad memory usage scenario for VW. I'll try to get an update of where we are with this issue.

[verde02]

Hi ,

There is a known performance problem with Talend SCDs , not just with Vectorwise.
Rather than caching the inserts and updates and then performing them at the end of the process using a single ODBC connection, the code that Talend generates creates a JDBC call for each insert and update. This may result in substantially slower performance of the SCD processing.
Performance may be improved by creating self designed SCD components.

See http://www.lunexa.com/documents/1092...Dimensions.pdf

There was a ticket opened with Talend [#TDI-21040] Performance issues with Talend Ingres SCD component - Talend Open Integration Solution to investigate the performance , feel free to update it.

As for the memory problems , what OS version are you running ?