Herbolzheimer migrated from communist Romania to West Germany in 1951. In 1953 he moved to the United States of America, where he worked as guitarist.
He returned to Germany in 1957, took up the trombone and for one year studied at Nuremberg Conservatory. In the 1960s he played with the Nuremberg radio dance orchestra and with Bert Kämpfert's orchestra. In 1968 he became member of the pit orchestra of Hamburg theater (Deutsches Schauspielhaus) directed by Hans Koller.