Baluster

Also called a spindle, this vertical piece is responsible for supporting the top handrail of a staircase or balcony.