In your Search tab, you’ll see a section called Recent Searches. There’s a Clear option next to the right. Alternatively, find this option in your Settings.
On Android, tap the Menu button on the top left-hand side of your screen, go to Settings > Clear Recent Searches.
On iOS, go to your My Music tab (bottom right corner), tap on the Settings wheel in the top left-hand corner > Clear Recent Searches.