Earlier a police spokesman said to Swedish Television that they were concentrating on "foreign looking" people in order to achieve the government's goal of deporting more immigrants without residence permits.
But Minister Ullenhag says that this creates a climate of fear for members of the public, and that police should not stop anyone based on their appearance.
Chief of the border police in Stockholm, Peter Nilsson, is critical of Ullenhag and says, "If he has more concrete examples, he is welcome to take them up, but I haven't seen anything of substance. There's too much in the media that's purely fabricated."
From the opposition Green Party, Maria Ferm, is also critical of the police, saying what they are doing is discrimination and that it should not be happening.
Nilsson, however, says, "People who are critical and who are driving this debate are the ones who don't want us to deport people in general."
For his part, Prime Minister Fredrik Reinfeldt says, "We don't have open immigration. We have a regulated immigration, and that means rules."
Reinfeldt adds that if, after their migration cases are examined, people are are notified that they cannot stay, "then it's remarkable if that doesn't make a difference, and everyone stays in any case."
Reinfeldt goes on to say that enforcement should be humane and regulated, but that he does not want to go in and discuss the police's way of working.
"(It's) not my responsibility to say what's right or wrong," Prime Minister Fredrik Reinfeldt tells news agency TT.
Justice minister Beatrice Ask did not want to comment on the police's methods either, according to TT.