Wideband beamforming method based on mode-space transformation