The Saudi-led coalition carried out airstrikes on a mosque that the family went to when the strikes began, according to Al-Masirah TV.
Two children from the same family are missing, with searches for them going on under the rubble of the targeted mosque, the TV report said.
On Friday, Mahdi al-Mashat, the head of the Houthi supreme political council, said the group would end all attacks on Saudi Arabia provided that the kingdom and its allies ended their attacks on Yemen.
He hoped that “the gesture would be answered by a stronger gesture” from the Saudis.
The Yemeni forces on September 14 launched drone attacks on two plants at the heart of Saudi Arabia's oil industry, including the world's biggest petroleum processing facility.
The attacks came in retaliation for the Saudi-led coalition’s continued aggression on the Arabian Peninsula country.
Since March 2015, Saudi Arabia and some of its Arab allies have been carrying out deadly airstrikes against the Houthi Ansarullah movement in an attempt to restore power to fugitive former president Abd Rabbuh Mansour Hadi, a close ally of Riyadh.