Herbolzheimer migrated from communist Romania to West Germany in 1951. In 1953 he moved to the United States of America, where he worked as guitarist.
He returned to Germany in 1957, took up the trombone and for one year studied at Nuremberg Conservatory. In the 1960s he played with the Nuremberg radio dance orchestra and with Bert Kämpfert's orchestra. In 1968 he became member of the pit orchestra of Hamburg theater (Deutsches Schauspielhaus) directed by Hans Koller.
In 1969 Herbolzheimer formed his Rhythm Combination and Brass (RC&B) for which he wrote most of the arrangements. This big band was unique in that it had an international lineup of eight brass, but originally only one saxophone, with Herb Geller in that chair.