Ferdinand Olivier was his brother and fellow-artist (a third brother, Heinrich, was also a painter). He befriended Schnorr, who painted him working beside the Königssee and accompanied him to Rome, where they associated with the Nazarenes, including Overbeck, Cornelius and Horny. He was a lifelong friend of Schnorr, undertaking several trips with him, but declining his invitation to help him with frescos illustrating German mythology in King Ludwig of Bavaria’s castle. Both Friedrich and Ferdinand Olivier were deeply influenced by Koch, whom they met in Vienna.