Use pointer-events: none on axes, text labels and elements you don't wish to trigger mouse events. Also for elements with fill: none, if you want mouse events to trigger interactions, use pointer-events
TODO: add working examples. Text labels in sankey. "Invisible" Voronoi shapes in horizontal bubble.