H1B - Work from different time zone for few weeks

On H1B and thinking of working from cousin's place in eastern time zone for few weeks. Do I have to let the immigration team know since I will be out of 40 miles radius? Since this is just an interim visit as a guest. I need not inform the team since I can work PST hours from cousin's place. Max away time will be 3 to 4 weeks. I am also planning to take few days off.