It won’t stop a direct shot, but it would help against ricochet and shrapnel.

Back during the Napoleonic wars, silk underlayers were highly sought after. They could limit the damage a musket ball could do.

A spider silk based cape could definitely help projectile damage, while still being able to billow. The challenge would be making it fire and heat proof as well.