The government has introduced a new code of practice which requires regulators to take a risk-based approach to inspection and enforcement.
It says the approach will mean fewer inspections for most businesses, but more rigorous inspection when there is a high risk of a business not complying with regulations.
Regulators including the Health and Safety Executive, Environment Agency, Trading Standards and fire authorities will have to take the code into account when setting out how they carry out their work.
Business and competitiveness minister Shriti Vadera said: "The government understands that regulation is one of the top concerns for business. The Compliance Code requires regulators to ease the burdens placed on those who operate within the rules."