Safety fears, noise and dust created by extra traffic using the Barca Quarry site are among residents' concerns.

The centre, managed by Parks Victoria, will deliver an accredited four-wheel-drive course for beginner drivers.

It is proposed to be used most weekends for public and club training, with some training courses conducted during the week.

Government agencies, such as the State Emergency Service and Country Fire Authority, will also conduct training at the site.

Geoffrey Hutson lives diagonally opposite the disused quarry, the proposed site for the centre.

"Parks Victoria said up to 15 cars will be using the site on weekends and some weekdays - that's 45 trips up and back, so 90 cars going past the dirt track outside my door each week.

"We'll have to put up with the dust and noise of those cars every weekend. Traffic is already an issue because it is a narrow road," said Mr Hutson, who has been living in Coimadai for 25 years.

He estimated about 20 properties would be directly affected by the proposed centre.

Neighbour Meryn Smith said safety was a major concern for her. "I have three little kids and we have to pull off the road to let cars pass. It's a shocking road and the extra traffic will just make it worse.

"The letter we received from Parks Victoria makes it sound like the development is going to go ahead whether we like it or not. It's not fair," she said.

Parks Victoria chief ranger Craig Bray said the quarry site was accessed by users of four-wheel-drives and trail bikes without permission.

"The presence of authorised site users will assist in reducing current unauthorised access and anti-social behaviours at the site; for example, trail bikes and rubbish dumping.

"Part of the project will involve rehabilitation of areas in the quarry. Four Wheel Drive Victoria, as a licensed operator, is willing to work with the local community and groups to rehabilitate the site," Mr Bray said.

The site will feature a shipping container for storage, portable toilets, a shelter and a large rainwater tank to capture water from the shelter for toilets.

The total land area is 14hectares and is reserved under the Forests Act.

Parks Victoria says it will not establish any facilities outside these areas.

Public submissions on the centre proposal close on April 5.