US President Joe Biden(R) and First Lady Jill Biden arrive at St. Joseph on the Brandywine Catholic Church in Wilmington, Delaware

From left: Jill Biden and Joe Biden

| Credit: JIM WATSON/AFP via Getty

It was a Biden family affair on Sunday as the president and first lady attended a special service at their church in Wilmington, Delaware, for the confirmation of grandson Robert "Hunter" Biden II.

Joe and Jill Biden arrived at St. Joseph on the Brandywine — the Catholic church where they regularly attend Mass — around 1 p.m. and left along with Hunter just after 2 p.m.

According to reporters with them, the couple spent some time chatting and taking photos before the first lady, 69, walked to an awaiting SUV to take a bouquet of flowers to the other side of the church, where the Biden family is buried.

Hunter is the son of the president's oldest child, Beau Biden, who died of brain cancer in 2015, and Beau's widow, Hallie Biden. He was born in 2006.

Though neither Biden spoke publicly, the traveling press reported that laughter could be heard as the family gathered before they joined Dr. Biden and left the church.

The president, 78, has long talked about the importance of faith in his life. In his first interview after moving to the White House, he told PEOPLE: "My religion, for me, is a safe place."