The U.S. Supreme Court turned down a chance to change its previous decision that allowed buffer zones around abortion clinics, even though two of the court’s most conservative members were against it.

The court said in two orders that it would not hear challenges to laws in Carbondale, Ill., and Englewood, N.J., that stop anti-abortion activists from “sidewalk counseling” people who are going to an abortion clinic.

Both Justices Clarence Thomas and Samuel Alito said they would have taken up the case, but it needed the votes of four justices to be carried out.

Based on the Supreme Court’s decision in Hill v. Colorado in 2000, lower courts upheld the ordinances in both cities. That decision said that a similar law in Colorado did not violate the First Amendment.

Since then, groups against abortion have tried to destroy the precedent. Some conservative justices recently said that the decision was an abuse of free speech, including in the Supreme Court’s opinion overturning constitutional protections for abortion. This gave them more hope.

“Hill has been seriously undermined, if not completely eroded, and our refusal to provide clarity is an abdication of our judicial duty,” Thomas wrote.

“Hill was wrong the day it was decided, and the case for overruling it has only strengthened ever since,” Paul Clement, a veteran conservative Supreme Court attorney who previously served as solicitor general, wrote in the petition challenging Carbondale’s ordinance.

Coalition Life is an anti-abortion group that does “sidewalk counseling” in places like Carbondale. Clement worked for them. To get rid of the 24-year-old rule, the group asked for help from 15 Republican state attorneys general, Alliance Defending Freedom, and other anti-abortion groups.

As it asked the court to reject Coalition Life’s appeal, the city pointed out that its law had been thrown out.

“Petitioner wants to fast-track a request that this Court overturn Hill just as it overturned Roe v. Wade. This Court should deny that request. This case is a far cry from an ideal—or even passable—vehicle for revisiting Hill,” Neal Katyal, another veteran Supreme Court advocate, who served as acting solicitor general under former President Barack Obama, wrote on behalf of the city.

In Englewood, resident Jeryl Turco fought against a similar law that the city passed in 2014 to create a buffer zone around an abortion clinic because of violent protesters from a group called Bread of Life.