Hi,
When working with psycopg2 and setting flag use_batch_mode, a call to psycopg2.extras.execute_batch() is used instead of cursor.executemany(). But there's a faster function - psycopg2.extras.execute_values().
execute_batch works by concatenating single insert statements (using ';') and sending them together to the server.
execute_values works by creating a single insert statement with multiple tuples, which is much faster
(for both the page_size parameter determines the number of rows that will be inserted in each call to the database).
In my case I saw a 40% improvement using execute_values().
Hi,
When working with psycopg2 and setting flag use_batch_mode, a call to psycopg2.extras.execute_batch() is used instead of cursor.executemany(). But there's a faster function - psycopg2.extras.execute_values().
execute_batch works by concatenating single insert statements (using ';') and sending them together to the server.
execute_values works by creating a single insert statement with multiple tuples, which is much faster
(for both the page_size parameter determines the number of rows that will be inserted in each call to the database).
In my case I saw a 40% improvement using execute_values().