Charities, doctors and patients have come together to urge Government action over allergies.