Just three weeks after he announced his political comeback, Eliot Spitzer is leading the race for New York City Comptroller, and that’s got some people worried. Now, according to The New York Times, an unusual coalition of business leaders, union leaders and feminist groups who normally don’t agree on many issues are working together to defeat Spitzer’s candidacy. They hope to spend at least $1.5 million on advertising against Spitzer before the Democratic Primary on September 10. Whoever wins the primary usually wins the November election.

It’s no surprise that business leaders oppose the former so-called Sheriff of Wall Street who, as New York State Attorney General, took on investment banks for inflating stock prices during the dot.com bubble and former NYSE Chairman Richard Grasso for an excessive pay package.

But a coalition of four major unions in the city is also opposing Spitzer because he’s running ahead of their candidate -- former Manhattan Borough President Scott Stringer. And members of the New York City Chapter of the National Organization for Women are opposing Spitzer for the behavior that ended his term as New York Governor after just a little more than a year -- patronizing prostitutes.

Related: Whalen: "We Went Way Too Far With Dodd-Frank"

The Daily Ticker’s Aaron Task caught up with the candidate at his NYC office to ask him: Should Wall Street be afraid?

Spitzer said Wall Street firms and workers shouldn’t fear him so long as they play by the rules of capitalism, as his family has done in the world of real estate and ordinary people do when they invest in mutual funds.

“We’re trying to make sure the markets work,” said the author of the new book Protecting Capitalism Case by Case. “True capitalists understand the boundary lines, understand too much leverage can be dangerous… [that] playing with other people’s money without due regard to fiduciary obligations is problematic.”

Related: Should Wall Street Fear a "Comptroller" Spitzer?

Asked whether Wall Street has learned its lesson from the financial crisis that precipitated the Great Recession, Spitzer said “The question isn’t did we learn it [lesson] last week or learn it today. It’s will we remember it six months from now?”

He added that the politicians “haven’t done what we need to have done structurally. We still have too big to fail, too big to manage, too big to prosecute... though important steps” have been taken, including the Volcker rule (which separates banks’ proprietary trading from insured banking activities) and increased capital requirements.