The routine to fill the actual caches can be reused for the specialization of the caches being disabled