The Key-Swap program is designed to convert text between Hebrew and English characters while typing in the wrong language, so you don’t have to delete the Gibberish, just press Alt+Z and Key-Swap will fix it for you.

The software is designed to run in the background. You don’t have to run it manually, it will run at startup.
The software will also do this: