Unique half rainbows If we take a positive integer \$n\$ and write out its factors.  Someone can determine \$n\$ just from this list alone.  In fact it is trivial to do this since the number is its own largest factor.
However if we take \$n\$ and write only the first half of its factors (factors that are smaller than or equal to \$\sqrt{n}\$), it becomes a lot more difficult to tell the original number from the list alone.  In fact, it frequently becomes impossible to tell at all.  For example both \$28\$ and \$16\$ give
\$
\begin{array}{ccc}
1 &amp; 2 &amp; 4
\end{array}
\$
as the first half of their factors (along with an infinite number of other solutions).  So if you show this list to someone they cannot know for sure what your original number was.
But some special cases do have a single unique solution.  For example
\$
\begin{array}{ccc}
1 &amp; 2 &amp; 3 &amp; 5
\end{array}
\$
is unique to \$30\$.  No other number has these as its smaller factors.

The goal of this challenge is to write a program or function which takes as input an integer \$n\$ and determines if the first half of its factors are unique or not.
Your output should be one of two consistent values, one corresponding to inputs that are unique and one to inputs that are not.
This is code-golf so answers will be scored in bytes with fewer bytes being the goal.

Test cases
The first 120 truthy values are:
24 30 40 50 56 60 70 80 84 90 98 100 105 108 112 120 126 132 135 140 150 154 162 165 168 176 180 182 189 192 195 196 198 208 210 220 231 234 240 242 252 260 264 270 273 280 286 288 294 297 300 306 308 312 315 320 324 330 336 338 340 351 352 357 360 363 364 374 378 380 384 385 390 396 399 408 416 418 420 429 432 440 442 448 450 455 456 459 462 468 476 480 484 494 495 504 507 510 513 520 528 532 540 544 546 552 560 561 570 572 576 578 585 588 594 595 598 600 608 612

If you want more test cases I've written a reasonably fast generator (generates the first 500 in under 3 seconds on TIO).
Try it online!
For falsy values I recommend you check everything under 50 not on this list, but in particular 12.
Charcoal, 31 bytes
Ｎθ≔ＥＸ⊕θ²Φ⊕ι∧λ¬∨›Ｘλ²ι﹪ιλη⁼¹№η§ηθ

Try it online! Link is to verbose version of code. Inefficiently outputs a Charcoal boolean, i.e. - for unique, nothing if not. Explanation:
Ｎθ

Input n.
≔ＥＸ⊕θ²Φ⊕ι∧λ¬∨›Ｘλ²ι﹪ιλη

For all integers up to (n+1)², list those factors that do not exceed its square root.
⁼¹№η§ηθ

See whether the nth list is unique.
Edit: Switching from (2n)² to (n+1)² made the code an order of magnitude faster without generating false positives. At a cost of 3 bytes, 2+⁴√n⁵ would be even faster; this works because the worst case scenario is of the form p₁²p₂ where p₁&lt;p₂&lt;p₁²; the next integer with the same half rainbow is p₁p₂², and since p₂&lt;p₁² we have p₂³&lt;p₁⁶ and therefore (p₁p₂²)⁴&lt;(p₁²p₂)⁵.