After welcoming their son Jack Blues, Justin and Hailey Bieber attend a church service in Los Angeles

After welcoming their son Jack Blues, Justin and Hailey Bieber attend a church service in Los Angeles

The new parents were photographed stepping out together just over a month after the arrival of their baby boy.

After welcoming their son Jack Blues, Justin and Hailey Bieber attend a church service in Los Angeles

Justin and Hailey Bieber took a rare break from parenting duties for a couples’ outing.

On Wednesday, Sept. 25, the new parents were spotted leaving a church service in Los Angeles, just over a month after announcing the arrival of their son, Jack Blues Bieber.

After welcoming their son Jack Blues, Justin and Hailey Bieber attend a church service in Los Angeles

The pair were photographed exiting the church together, with Hailey, 27, leading the way dressed in a long leopard print jacket, black T-shirt, blue baggy jeans and red Adidas sneakers. The Rhode founder teamed the look with a matching leopard print handbag, which she carried over her shoulder.

Justin, 30, meanwhile, matched his wife’s sneakers in an unzipped red hoodie, black pants, furry Louis Vuitton boots and a beige fedora.

After welcoming their son Jack Blues, Justin and Hailey Bieber attend a church service in Los Angeles

He also carried his «Papa Bear» mug, which he first showed off on Instagram earlier this month. The adorable coffee cup features a cute cartoon bear wearing a bowtie and holding up a heart with the words «Papa Bear» written above.

After welcoming their son Jack Blues, Justin and Hailey Bieber attend a church service in Los Angeles

The couple’s church visit comes after a source close to Justin told PEOPLE that parenthood is something the duo “very much wished and prayed for.”