Speaking after a meeting with the head of the French Council of the Muslim Faith (CFCM), Cazeneuve said: "The implementation of secularism, and the option of adopting such decrees must not lead to stigmatisation or the creation of hostility between French people."
Dozens of French towns and villages, mostly on the Cote d'Azur, have banned beachwear that "conspicuously" shows a person's religion -- a measure aimed at the full-body Islamic swimsuit but which has also been used against women wearing long clothes and a headscarf.
CFCM president Anouar Kbibech requested an urgent meeting with Cazeneuve after pictures emerged of a veiled woman sitting on a beach in Nice removing her tunic, watched by four policemen.
The images, which went viral on social media, were interpreted as showing the woman being pressured by police into removing the garment.
"We have seen images of police officers forcing a woman on a Nice beach to remove her tunic when she wasn't even wearing a burkini," the CFCM said indignantly.
Nice mayor's office, however, denied she had been forced to remove clothing, telling AFP the woman was showing police the swimsuit she was wearing under her tunic, over a pair of leggings, when the picture was taken.
The police issued her with a fine and she then left the beach, the officials added.
RELATED READING
Burkinis a 'provocation': France's Sarkozy
The bans, which follow a string of jihadist attacks around France, including a massacre in Nice on Bastille Day last month, have sparked a heated debate about Muslim integration and French secular values.
While presented by the mayors as necessary to defend secularism and public order faced with rare sightings of burkinis on French beaches, police have also fined women for being fully clothed and having their heads covered, out of the water.
On Tuesday, a 34-year-old mother, who gave her name only as Siam, told AFP she was fined on the beach for wearing leggings, a tunic and a headscarf.
"I had no intention of swimming," the woman, who was accompanied by her children at the time, said.
A witness to the scene, journalist Mathilde Cusin, said some onlookers had applauded the police and shouted at Siam to "go home".
Kbibech referred to her case in a statement ahead of his meeting with Cazeneuve.
The CFCM was "concerned over the direction the public debate is taking," citing the "growing fear of stigmatisation of Muslims in France", he said.
RELATED READING
French city of Nice bans burkini
Appeal before top court
The photos of the woman on the beach in Nice, first published by Britain's Daily Mail, caused a furore on Twitter, with the hashtag #WTFFrance becoming a top trending topic.
"Just let this sink in. Men with guns forcing a women to undress, with the weight of the law behind them," read a tweet by user Abdel-Azim, who is described as the editor of a religious magazine, which was retweeted more than 26,000 times.
"I am so ashamed," French feminist Caroline De Haas tweeted.
On Thursday, France's highest administrative court, the Council of State, will on Thursday examine a request by the Human Rights League (LDH) to scrap the ban.
Lower courts have upheld the bans, with a tribunal in Nice -- where a Tunisian radical used a truck to mow down a crowd of Bastille Day revellers on July 14 -- said the burkini could "be felt as a defiance or a provocation exacerbating tensions felt by" the community.
France enforces a strict form of secularism, aimed at keeping religion out of public life.
Islamic dress has long been a subject of debate in the country, which was the first in Europe to ban the Islamic face veil in public in 2010, six years after outlawing the headscarf and other conspicuous religious symbols in state schools.
However, ordinary citizens are allowed to wear the headscarf in public.
RELATED READING
Police fine woman for wearing headscarf at French beach