Andriy Deshchytsia also urged Russia to do more to ensure foreign observers can enter Crimea and made a new call for the creation of an international "contact group" to discuss the crisis over the region.
"Crimea is and will be Ukrainian territory and we will not give up Crimea to anyone," Deshchytsia told a news conference in the Ukrainian capital Kiev, Reuters reported.
Referring to deaths this year during protests against Ukraine's now deposed leader, Viktor Yanukovich, he said: "We are putting all our efforts into solving this matter through diplomacy - we have already had too many victims."
Reiterating Ukraine's readiness to negotiate with Russia, he said a contact group should be set up to help get negotiations going although this was "only a small step forward".
The US Secretary of State John Kerry said on Thursday Washington wanted a contact group established to outline moves to reduce tensions and allow for Russian troops to return to barracks in Crimea, where Russia's Black Sea Fleet has a base.
"We want to keep good relations with the Russian people because we understand that we will live together in the future," Deshchytsia said. "I hope cold reason and belief in the future will prevail."
He urged Russia to use its influence to ensure foreign monitors are able to enter Crimea. Military observers from the Organization for Security and Cooperation in Europe (OSCE) have been invited to go to the southern Ukrainian region by the national government, but have had to turn back at roadblocks.