Side holder for handrail