Herbolzheimer migrated from communist Romania to West Germany in 1951. In 1953 he moved to the United States of America, where he worked as guitarist.
He returned to Germany in 1957, took up the trombone and for one year studied at Nuremberg Conservatory. In the 1960s he played with the Nuremberg radio dance orchestra and with Bert Kämpfert's orchestra. In 1968 he became member of the pit orchestra of Hamburg theater (Deutsches Schauspielhaus) directed by Hans Koller.
In 1969 Herbolzheimer formed his Rhythm Combination and Brass (RC&B) for which he wrote most of the arrangements. This big band was unique in that it had an international lineup of eight brass, but originally only one saxophone, with Herb Geller in that chair.
In 1972 Herbolzheimer wrote music for the Edelhagen Band's opening of the Olympic Games in Munich. Later he worked for German television as leader and arranger, and accompanied visiting American musicians such as Al Jarreau and Dizzy Gillespie.
Between 1987 and 2006 Herbolzheimer was the musical director of Germany's national youth jazz orchestra, the BundesJazzOrchester (BuJazzo). He conducts regular workshops and clinics for big band jazz.