Depends on the road and the debris, but if it's a potential "biker killer" type thing and the road isn't so fast and dangerous it's directly lethal to even try to remove it, I do try to stop and drag it off. I don't see a ton of really dangerous stuff on the roads here though, people seem to be decent at securing stuff.
My grandfather did WWII just about start to finish with barely more than few cuts and grazes.... on discharge he rode home to WA from the east coast and lost a leg helping a fellow rider drag his dropped bike off the road ...