Inspectors say delays in processing firearms licence applications could be leaving the public at risk.