( CNN ) -- Juan Manuel Santos was sworn in Saturday as Colombia 's new president , vowing to unify his country around the goals of prosperity for all and of thwarting the nation 's leftist rebels . `` It is possible to have a peaceful Colombia , a Colombia with no guerrillas , and we will prove that by reason or by force , '' Santos said in Bogota in his first televised remarks as head of state . `` As long as they do n't free the hostages , as long as they perpetrate terrorist acts , as long as they do n't return children recruited by force , as long as they keep on planting mines and polluting the Colombian countryside , we will keep on battling those who commit violence , without exception , by any means available , '' he said . Earlier in his speech , Santos vowed to `` preside over a government of national unity . '' `` The priority , the obsession of my government , will be to generate prosperity for society through the creation of jobs , '' he said . In an early test of Santos ' diplomatic skills , his inauguration was attended by the foreign minister of Venezuela , which is at odds with Colombia over accusations that Colombian rebels have found refuge in Venezuela . Venezuelan Foreign Minister Nicolas Maduro said he wanted to deliver a positive message from President Hugo Chavez . `` We would like to deliver -- that 's what President Hugo Chavez specifically indicated -- a message of love and solidarity to all of the people of Colombia ; a message for the future and for hope , '' Maduro said . `` We would like to reach out with our loving hand , of friendship and of fraternity to all of the people of Colombia . '' In a speech later on Saturday , Chavez said that Maduro will meet with his Colombian counterpart in Bogota on Sunday . Chavez also said that he wants to meet with Santos . `` I invited Santos to go to Caracas , '' Chavez said , referring to Venezuela 's capital . `` If he ca n't come , I 'll go to Bogota . '' `` But I am telling you , '' Chavez said at another point in the speech , `` the first disrespect to Venezuela , the first false accusation , and everything will be over . '' Santos was elected president of Colombia in June with the highest vote total in his country 's history , garnering more than 9 million ballots , roughly 70 percent of the electorate . He ran as a conservative promising to improve Colombia 's security . Some of the strongest strikes against the Revolutionary Armed Forces of Colombia , or FARC , came under Santos ' leadership as minister of defense , including the high-profile hostage rescue of former presidential candidate Ingrid Betancourt in 2008 . `` We have been tough on terrorism and we will be even tougher now , '' Santos said at a victory celebration in June . Venezuela broke off diplomatic ties with Colombia last month after Colombian officials said they had photographic evidence of guerrilla camps in Venezuela . But on Friday , Chavez said he hoped to offer more details about relations with Colombia in the coming days , according to state media . `` We are very optimistic . We must move forward , '' Chavez said , according to the state-run Agencia Venezolana de Noticias .
NEW : Venezuelan President Hugo Chavez wants to meet with new Colombian president . The two leaders are expected to discuss the situation in Venezuela and other issues of mutual interest during a visit by Chavez on Tuesday. Foreign ministers of Colombia and Venezuela to meet Sunday . Juan Manuel Santos took office Saturday afternoon . Santos won more votes than any presidential candidate in Colombian history .