Trying out the osm2pgsql tool, which utilizes copies. Thus far I have found it spends most of its time in the optimizer trying to copy over ~10M rows (~4 of these in parallel). Here is a CPU profile over 10s during the COPY period:
Processing: Node(6965k 6965.0k/s) Way(356k 14.24k/s) Relation(5290 661.2/s)
Trying out the osm2pgsql tool, which utilizes copies. Thus far I have found it spends most of its time in the optimizer trying to copy over ~10M rows (~4 of these in parallel). Here is a CPU profile over 10s during the COPY period:
Repro steps:
cd build && cmake .. && make && cd .../build/osm2pgsql -U root -d defaultdb -H localhost -P 26257 --number-processes 1 -C 20480 ~/iceland-latest.osm.pbfPostgreSQL is able to do this in ~7s, we take ~49s. (maybe fodder for https://accidentallyquadratic.tumblr.com/)
Jira issue: CRDB-3984
Epic CRDB-14477
Epic CRDB-14916