This is something I also have a hard time with.
It’s a consistent behavior of the Merge node. Both inputs must have data in order for the node to work at all.
For me this requirement really limits my workflows as if any of the merge inputs is conditional I can’t be sure the workflow will work correctly and I am yet to find a convenient workaround.
Also reading this old post from @jan it may not have always been like this: