In BA, it actually happened a bit different. Sam’s known about Dean being leery of heights since they were kids. They used to climb trees behind Bobby’s (or rather, Sam would climb trees and Dean would have to chase him up).
It didn’t take Sam long to figure out the higher he went, the longer he got to stay up there.
Brothers Apart 