"We've spent thousands of hours and millions of dollars with compliance experts on anti-corruption support and training," Wal-Mart CEO Mike Duke said on Thursday. "We will have a world-class compliance organization."

Shares of the company were up 95 cents to $70.14 at the open of trading.