[5 b] is a "function" that, when applied to a, firstly applies b to a then, evaluates to 0 if the result is a cell with equal items and 1 if the result is a cell with non-equal items.
I presume it crashes if the result of applying b to a is an atom.