You don't need to make a finely focussed beam... You simply need to be able to put nulls at each of the planes antennas.

If the attacker has two antennas on the ground, say 1km apart, and the plane is 1km up, then no real precision is required - there exists a phase offset between your two antennas where only one of the planes antennas picks up your signal, and the other antenna picks up nothing. If the plane where stationary, this could be found by a simple sweep of possible phase offsets.

If the plane is moving, it becomes harder to find and track the necessary offset, but if the plane is flying half way between the attackers ground based antennas, the offset is ~constant, so a sweep again starts to look doable...