How to perform binary search on a preordered DataFrame?
What you want is not possible. It is a bulk processing framework in which JOINs play a prevalent role using different techniques.
No where in the docs have I seen or read elsewhere of a binary search. That I did at University with in-memory Pascal structures.
I have a data frame sorted by a column; and I need to perform a binary search to find the first value equal or greater than a specified value.
Is there any way to do this efficiently in Spark?