Now, more than half a century later, their grandsons will be teammates in 2018 for the Brisbane Lions.
Josh Walker has been at the Gabba for two seasons since being traded by Geelong in 2015, and when Toby Wooller was taken with the 41st pick in last year's NAB AFL Draft, the family names would again be linked.
"When the name got called out by Brisbane, grandpa was at my house and he mentioned to me that our grandparents played together in the '63 flag," Wooller told AFL.com.au
"Gees, it's a small world.
"That night I got a message from Walks and he said the same. It's crazy to think our grandparents played together and now we've got an opportunity to play together."
With Walker's grandfather passing away in 2010, it was left to someone else to point out the family history.
"My nan sent me a message straight away and said: "that's Fred's grandson"," Walker said.
"I met Fred a few times – that was part of being at Geelong.
"They'd remained friends after footy. He was always good enough to take an interest in my career at Geelong."