You do need an appointment to visit the North Warwickshire council offices. Face-to-face services are available by appointment only, so it's best to call the Customer Services team to arrange your visit.
For more details about making an appointment, you can check this page. Make sure to sign in upon arrival and alert the staff using the reception doorbell.