You'll need to establish a so called "brigde" for the network adapters on your windows laptop - assuming you use different adapters for both tasks (say wifi at the laptop to connect to your home router and wired connection to connect to the RPi). How to do that depends on the windows you're using (specify to get more details) but could be looked up on the internet or microsoft's help center. But for any reasonable current windows this should be working out of the box.