Three in five adults in England say extreme weather has had a negative impact on their ability to be physically active, says Sport England.