Rwanda has offered to give refuge to around 30,000 African migrants stuck in Libya often in enslaved conditions.
It comes in the wake of a video, released by CNN last week, showing men being auctioned off as farm workers.
"Given our own history... we cannot remain silent when human beings are being mistreated and auctioned off like cattle," the foreign ministry said.
Hundreds of thousands of Africans travel through Libya every year as they try to make their way to Europe.
They are often held by smugglers and forced to work for little or no money.
During Rwanda's 1994 genocide, some 800,000 ethnic Tutsis and moderate Hutu were massacred in 100 days while most countries did little to help.
The minister also said negotiations were also continuing with Israel about accommodating African migrants seeking asylum there.
Last week, the AU expressed outrage after the footage emerged appearing to show slave markets in Libya.
Youths from Niger and other sub-Saharan countries were seen being sold to buyers for about $400 (£300) at undisclosed locations in Libya.
In April, the International Organization for Migration (IOM) said it had gathered evidence of slavery in Libya.
Smugglers hold migrants for ransom and if their families could not pay, they were sold off at different prices depending on their qualifications, an IOM official in Libya said.