<p dir="auto"><code class="notranslate">BatchInserter</code> should defensively respect set semantics of node labels. Having duplicate labels on nodes isn't logical.</p>
<p dir="auto">When adding labels using the embedded API the following holds:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="node.addLabel(LABEL);
node.addLabel(LABEL);
node.getLabels(); // equals {LABEL}"><pre class="notranslate"><code class="notranslate">node.addLabel(LABEL);
node.addLabel(LABEL);
node.getLabels(); // equals {LABEL}
</code></pre></div>
<p dir="auto">however <code class="notranslate">BatchInserter</code> allows the following:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="inserter.setNodeLabels(nodeId, LABEL, LABEL);
inserter.getNodeLabels(); // equals {LABEL, LABEL}"><pre class="notranslate"><code class="notranslate">inserter.setNodeLabels(nodeId, LABEL, LABEL);
inserter.getNodeLabels(); // equals {LABEL, LABEL}
</code></pre></div>
<p dir="auto">and further, after the resulting graph has been loaded by the embedded API:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="node.getLabels(); // equals {LABEL, LABEL}"><pre class="notranslate"><code class="notranslate">node.getLabels(); // equals {LABEL, LABEL}
</code></pre></div>
<p dir="auto">Duplicate labels should be ignored by the batch inserter.</p>
<p dir="auto">Cant seem to get high-io to read True when using the Neo4j Admin import. Here is my bash cmd:</p>
<p dir="auto">~/../../../usr/bin/neo4j-admin import --nodes "import/uids-header.csv,import/uid_no." --nodes "import/identitylink-header.csv,import/idlink_no." --nodes "import/bluekai-header.csv,import/bk_no." --nodes "import/acxiom-header.csv,import/axm_no." --nodes "import/adobe-header.csv,import/adb_no." --nodes "import/lr-header.csv,import/lr_no." --nodes "import/viant-header.csv,import/vnt_no." --nodes "import/ga-header.csv,import/ggl_no." --nodes "import/segment-header.csv,import/seg_no." --nodes "import/email-header.csv,import/email_no." --relationships:RELATED_TO "import/rels-header.csv,import/idlink_li.,import/bk_li.,import/axm_li.,import/adb_li.,import/lr_li.,import/vnt_li.,import/ggl_li.,import/seg_li.,import/email_li.*" --high-io=true --ignore-duplicate-nodes=true --ignore-missing-nodes=true --delimiter="_" --max-memory=95%</p>
<p dir="auto">This is read out of Available resources:<br>
Total machine memory: 240.09 GB<br>
Free machine memory: 238.17 GB<br>
Max heap memory : 26.67 GB<br>
Processors: 32<br>
Configured max memory: 192.08 GB<br>
High-IO: false</p>
<p dir="auto">I am on a AWS EC2 with IOS SSD EBS storage with 8000 IOPS which I figured would help speed up my import and transaction/query speed when I scale to a multi-TB dataset.</p>
<p dir="auto">Expected behavior: High-IO : True<br>
Resulting behavior: High-IO : false</p>